title: Towards On-Board Panoptic Segmentation of Multispectral Satellite Images

abstract: With tremendous advancements in low-power embedded computing devices and remote sensing instruments, the traditional satellite image processing pipeline which includes an expensive data transfer step prior to processing data on the ground is being replaced by on-board processing of captured data. This paradigm shift enables critical and time-sensitive analytic intelligence to be acquired in a timely manner on-board the satellite itself. However, at present, the on-board processing of multi-spectral satellite images is limited to classification and segmentation tasks. Extending this processing to its next logical level, in this paper we propose a lightweight pipeline for on-board panoptic segmentation of multi-spectral satellite images. Panoptic segmentation offers major economic and environmental insights, ranging from yield estimation from agricultural lands to intelligence for complex military applications. Nevertheless, the on-board intelligence extraction raises several challenges due to the loss of temporal observations and the need to generate predictions from a single image sample. To address this challenge, we propose a multimodal teacher network based on a cross-modality attention-based fusion strategy to improve the segmentation accuracy by exploiting data from multiple modes. We also propose an online knowledge distillation framework to transfer the knowledge learned by this multi-modal teacher network to a uni-modal student which receives only a single frame input, and is more appropriate for an on-board environment. We benchmark our approach against existing state-of-the-art panoptic segmentation models using the PASTIS multi-spectral panoptic segmentation dataset considering an on-board processing setting. Our evaluations demonstrate a substantial increase in accuracy metrics compared to the existing state-of-the-art models.


title: A vindication of the RR Lyrae Fourier light curve decomposition for the calculation of metallicity and distance in globular clusters

abstract: We report the mean metallicity and absolute magnitude of RR Lyrae stars in a sample of 37 globular clusters, calculated via the Fourier decomposition of their light curves and ad hoc semiempirical calibrations, in an unprecedented homogeneous approach. This enabled a new discussion of the metallicity dependence of the horizontal branch (HB) luminosity, as a fundamental distance indicator. The calibration for the RRab and RRc stars should be treated separately. For the RRab the dispersion is larger and non-linear. For the RRc stars the correlation is less steep, very tight and linear. The relevance of the HB structural parameter L, is highlighted and offer a non-linear calibration of the form MV ([Fe/H],L). Excellent agreement is found between values of [Fe/H] and MV from the light curve decomposition with spectroscopic values and distances obtained via Gaia-DR3 and HST. The variable stars census in 35 clusters includes 326 stars found by our program.


title: Application of a Spectral Method to Simulate Quasi-Three-Dimensional Underwater Acoustic Fields

abstract: The calculation of a three-dimensional underwater acoustic field has always been a key problem in computational ocean acoustics. Traditionally, this solution is usually obtained by directly solving the acoustic Helmholtz equation using a finite difference or finite element algorithm. Solving the three-dimensional Helmholtz equation directly is computationally expensive. For quasi-three-dimensional problems, the Helmholtz equation can be processed by the integral transformation approach, which can greatly reduce the computational cost. In this paper, a numerical algorithm for a quasi-three-dimensional sound field that combines an integral transformation technique, stepwise coupled modes and a spectral method is designed. The quasi-three-dimensional problem is transformed into a two-dimensional problem using an integral transformation strategy. A stepwise approximation is then used to discretize the range dependence of the two-dimensional problem; this approximation is essentially a physical discretization that further reduces the range-dependent two-dimensional problem to a one-dimensional problem. Finally, the Chebyshev--Tau spectral method is employed to accurately solve the one-dimensional problem. We provide the corresponding numerical program SPEC3D for the proposed algorithm and describe several representative numerical examples. In the numerical experiments, the consistency between SPEC3D and the analytical solution/high-precision finite difference program COACH verifies the reliability and capability of the proposed algorithm. A comparison of running times illustrates that the algorithm proposed in this paper is significantly faster than the full three-dimensional algorithm in terms of computational speed.


title: Autoregressive 3D Shape Generation via Canonical Mapping

abstract: With the capacity of modeling long-range dependencies in sequential data, transformers have shown remarkable performances in a variety of generative tasks such as image, audio, and text generation. Yet, taming them in generating less structured and voluminous data formats such as high-resolution point clouds have seldom been explored due to ambiguous sequentialization processes and infeasible computation burden. In this paper, we aim to further exploit the power of transformers and employ them for the task of 3D point cloud generation. The key idea is to decompose point clouds of one category into semantically aligned sequences of shape compositions, via a learned canonical space. These shape compositions can then be quantized and used to learn a context-rich composition codebook for point cloud generation. Experimental results on point cloud reconstruction and unconditional generation show that our model performs favorably against state-of-the-art approaches. Furthermore, our model can be easily extended to multi-modal shape completion as an application for conditional shape generation.


title: PSDoodle: Fast App Screen Search via Partial Screen Doodle

abstract: Searching through existing repositories for a specific mobile app screen design is currently either slow or tedious. Such searches are either limited to basic keyword searches (Google Image Search) or require as input a complete query screen image (SWIRE). A promising alternative is interactive partial sketching, which is more structured than keyword search and faster than complete-screen queries. PSDoodle is the first system to allow interactive search of screens via interactive sketching. PSDoodle is built on top of a combination of the Rico repository of some 58k Android app screens, the Google QuickDraw dataset of icon-level doodles, and DoodleUINet, a curated corpus of some 10k app icon doodles collected from hundreds of individuals. In our evaluation with third-party software developers, PSDoodle provided similar top-10 screen retrieval accuracy as the state of the art from the SWIRE line of work, while cutting the average time required about in half.


title: Discussions on the nature of GLEAM-X J162759.5-523504.3

abstract: The nature of the long period radio transient GLEAM-X J162759.5$-$523504.3 (GLEAM-X J1627 for short) is discussed. We try to understand both its radio emission and pulsation in the neutron star scenario, as an alternative to the white dwarf model. We think that: (1) From the radio emission point of view, GLEAM-X J1627 can be a radio-loud magnetar. (2) From the rotational evolution point of view, GLEAM-X J1627 is unlikely to be an isolated magnetar. (3) The 1091s period is unlikely to be the precession period. (4) GLEAM-X J1627 may be a radio-loud magnetar spin-down by a fallback disk. (5) The pulsar death line is modified due to the presence of a fallback disk or a twisted magnetic field. In both cases, a higher maximum acceleration potential can be obtained. This may explain why GLEAM-X J1627 is still radio active with such a long pulsation period. (6) General constraint on the neutron star magnetic field and initial disk mass are given analytically. Possible ways to discriminate between different modelings are also discussed.


title: Radio Transient Detection with Closure Products and Machine Learning

abstract: For transient sources with timescales of 1-100 seconds, standardized imaging for all observations at each time step become impossible as large modern interferometers produce significantly large data volumes in this observation time frame. Here we propose a method based on machine learning and using interferometric closure products as input features to detect transient source candidates directly from the spatial frequency domain without imaging. We train a simple neural network classifier on a synthetic dataset of Noise/Transient/RFI events, which we construct to tackle the lack of labelled data. We also use the hyper-parameter dropout rate of the model to allow the model to approximate Bayesian inference, and select the optimal dropout rate to match the posterior prediction to the actual underlying probability distribution of the detected events. The overall F1-score of the classifier on the simulated dataset is greater than 85\%, with the signal-to-noise at 7$\sigma$. The performance of the trained neural network with Monte Carlo dropout is evaluated on semi-real data, which includes a simulated transient source and real noise. This classifier accurately identifies the presence of transient signals in the detectable signal-to-noise levels (above 4$\sigma$) with the optimal variance. Our findings suggest that a feasible radio transient classifier can be built up with only simulated data for applying to the prediction of real observation, even in the absence of annotated real samples for the purpose of training.


title: Data Augmentation for Intent Classification with Off-the-shelf Large Language Models

abstract: Data augmentation is a widely employed technique to alleviate the problem of data scarcity. In this work, we propose a prompting-based approach to generate labelled training data for intent classification with off-the-shelf language models (LMs) such as GPT-3. An advantage of this method is that no task-specific LM-fine-tuning for data generation is required; hence the method requires no hyper-parameter tuning and is applicable even when the available training data is very scarce. We evaluate the proposed method in a few-shot setting on four diverse intent classification tasks. We find that GPT-generated data significantly boosts the performance of intent classifiers when intents in consideration are sufficiently distinct from each other. In tasks with semantically close intents, we observe that the generated data is less helpful. Our analysis shows that this is because GPT often generates utterances that belong to a closely-related intent instead of the desired one. We present preliminary evidence that a prompting-based GPT classifier could be helpful in filtering the generated data to enhance its quality.


title: FaceSigns: Semi-Fragile Neural Watermarks for Media Authentication and Countering Deepfakes

abstract: Deepfakes and manipulated media are becoming a prominent threat due to the recent advances in realistic image and video synthesis techniques. There have been several attempts at combating Deepfakes using machine learning classifiers. However, such classifiers do not generalize well to black-box image synthesis techniques and have been shown to be vulnerable to adversarial examples. To address these challenges, we introduce a deep learning based semi-fragile watermarking technique that allows media authentication by verifying an invisible secret message embedded in the image pixels. Instead of identifying and detecting fake media using visual artifacts, we propose to proactively embed a semi-fragile watermark into a real image so that we can prove its authenticity when needed. Our watermarking framework is designed to be fragile to facial manipulations or tampering while being robust to benign image-processing operations such as image compression, scaling, saturation, contrast adjustments etc. This allows images shared over the internet to retain the verifiable watermark as long as face-swapping or any other Deepfake modification technique is not applied. We demonstrate that FaceSigns can embed a 128 bit secret as an imperceptible image watermark that can be recovered with a high bit recovery accuracy at several compression levels, while being non-recoverable when unseen Deepfake manipulations are applied. For a set of unseen benign and Deepfake manipulations studied in our work, FaceSigns can reliably detect manipulated content with an AUC score of 0.996 which is significantly higher than prior image watermarking and steganography techniques.


title: Molecular states from $\bar{B}^{(*)}N$ interactions

abstract: In 2019, two new structures $\Lambda_b(6146)$ and $\Lambda_b(6152)$ were observed by the LHCb Collaboration at the invariant mass spectrum of $\Lambda_b^0\pi^{+}\pi^{-}$, which aroused a hot discussion about their inner structures. The $\Lambda_b(6146)$ and $\Lambda_b(6152)$ might still be molecular states because their masses are close to threshold of a $\bar{B}$ meson and a nucleon. In this work, we perform a systematical investigation of possible heavy baryonic molecular states from the $\bar{B}N$ interaction. Since the $\bar{B}N$ channel strongly couples to the $\bar{B}^{*}N$ channel, the possible $\bar{B}N-\bar{B}^{*}N$ bound states are also studied. The interaction of the system considered is described by the $t$-channel $\sigma$, $\pi$, $\eta$ ,$\omega$, and $\rho$ mesons exchanges. By solving the non-relativistic Schr\"{o}dinger equation with the obtained one-boson-exchange potentials, the $\bar{B}^{(*)}N$ bound states with different quantum numbers are searched. The calculation suggests that recently observed $\Lambda_b(6146)$ can be assigned as a $P$-wave $\bar{B}N$ molecular state with spin parity $J^P=3/2^{+}$ or a $\bar{B}N-\bar{B}^{*}N$ bound state. However, assignment of $\Lambda_b(6152)$ as an $F$-wave $\bar{B}N$ molecular is disfavored. The $\Lambda_b(6152)$ can be explained as meson-baryon molecular state with a small $\bar{B}N$ component. The calculation also predict the existence of two $S$-wave $\bar{B}N-\bar{B}^{*}N$ bound states that can be related to the experimentally observed $\Lambda_b(5912)$ and $\Lambda_b(5920)$.


title: Buy-Many Mechanisms for Many Unit-Demand Buyers

abstract: A recent line of research has established a novel desideratum for designing approximately-revenue-optimal multi-item mechanisms, namely the buy-many constraint. Under this constraint, prices for different allocations made by the mechanism must be subadditive, implying that the price of a bundle cannot exceed the sum of prices of individual items it contains. This natural constraint has enabled several positive results in multi-item mechanism design bypassing well-established impossibility results. Our work addresses the main open question from this literature of extending the buy-many constraint to multiple buyer settings and developing an approximation. We propose a new revenue benchmark for multi-buyer mechanisms via an ex-ante relaxation that captures several different ways of extending the buy-many constraint to the multi-buyer setting. Our main result is that a simple sequential item pricing mechanism with buyer-specific prices can achieve an $O(\log m)$ approximation to this revenue benchmark when all buyers have unit-demand or additive preferences over m items. This is the best possible as it directly matches the previous results for the single-buyer setting where no simple mechanism can obtain a better approximation. From a technical viewpoint we make two novel contributions. First, we develop a supply-constrained version of buy-many approximation for a single buyer. Second, we develop a multi-dimensional online contention resolution scheme for unit-demand buyers that may be of independent interest in mechanism design.


title: Lelong Numbers of $m$-Subharmonic Functions Along Submanifolds

abstract: We study the possible singularities of an $m$-subharmonic function $\varphi$ along a complex submanifold $V$ of a compact K\"ahler manifold, finding a maximal rate of growth for $\varphi$ which depends only on $m$ and $k$, the codimension of $V$. When $k < m$, we show that $\varphi$ has at worst log poles along $V$, and that the strength of these poles is moveover constant along $V$. This can be thought of as an analogue of Siu's theorem.


title: BcMON: Blockchain Middleware for Offline Networks

abstract: Blockchain is becoming a new generation of information infrastructures. However, the current blockchain solutions rely on a continuous connectivity network to query and modify the state of the blockchain. The emerging satellite technology seems to be a good catalyst to forward offline transactions to the blockchain. However, this approach suffers expensive costs, difficult interoperability, and limited computation problems. Therefore, we propose BcMON, the first blockchain middleware for offline networks. BcMON incorporates three innovative designs: 1) it reduces the costs of offline transactions accessing the blockchain through Short Message Service (SMS), 2) it validates the authenticity of offline cross-chain transactions by two-phase consensus, 3) it supports offline clients to perform complex queries and computations on the blockchains. The prototype of BcMON has been implemented to evaluate the performance of the proposed middleware, which can show its stability, efficiency, and scalability.


title: Controllable Garment Transfer

abstract: Image-based garment transfer replaces the garment on the target human with the desired garment; this enables users to virtually view themselves in the desired garment. To this end, many approaches have been proposed using the generative model and have shown promising results. However, most fail to provide the user with on the fly garment modification functionality. We aim to add this customizable option of "garment tweaking" to our model to control garment attributes, such as sleeve length, waist width, and garment texture.


title: Time Efficient Joint UAV-BS Deployment and User Association based on Machine Learning

abstract: This paper proposes a time-efficient mechanism to decrease the on-line computing time of solving the joint unmanned aerial vehicle base station (UAV-BS) deployment and user/sensor association (UDUA) problem aiming at maximizing the downlink sum transmission throughput. The joint UDUA problem is decoupled into two sub-problems: one is the user association sub-problem, which gets the optimal matching strategy between aerial and ground nodes for certain UAV-BS positions; and the other is the UAV-BS deployment sub-problem trying to find the best position combination of the UAV-BSs that make the solution of the first sub-problem optimal among all the possible position combinations of the UAV-BSs. In the proposed mechanism, we transform the user association sub-problem into an equivalent bipartite matching problem and solve it using the Kuhn-Munkres algorithm. For the UAV-BS deployment sub-problem, we theoretically prove that adopting the best UAV-BS deployment strategy of a previous user distribution for each new user distribution will introduce little performance decline compared with the new user distribution's ground true best strategy if the two user distributions are similar enough. Based on our mathematical analyses, the similarity level between user distributions is well defined and becomes the key to solve the second sub-problem. Numerical results indicate that the proposed UDUA mechanism can achieve near-optimal system performance in terms of average downlink sum transmission throughput and failure rate with enormously reduced computing time compared with benchmark approaches.


title: Angle-resolved polarized Raman spectroscopy for distinguishing stage-I graphite intercalation compounds with Thorium, Uranium and Plutonium

abstract: Graphite intercalation compounds (GICs) with the geometrical anisotropy and strong electron-phonon coupling are in full swing and have shown their great potential for applications in nanodevices. I selected representative three elements in actinide group with valence electron arrangement: Thorium (Th) ([Rn]6d27s2), Uranium (U) ([Rn]5f36d17s2), Plutonium (Pu) ([Rn]5f67s2). I calculated their phonon spectra and demonstrated the atomic-scale microstructure identification of actinide graphite intercalation compounds by angle-resolved polarized Raman spectroscopy.


title: PSDoodle: Searching for App Screens via Interactive Sketching

abstract: Keyword-based mobile screen search does not account for screen content and fails to operate as a universal tool for all levels of users. Visual searching (e.g., image, sketch) is structured and easy to adopt. Current visual search approaches count on a complete screen and are therefore slow and tedious. PSDoodle employs a deep neural network to recognize partial screen element drawings instantly on a digital drawing interface and shows results in real-time. PSDoodle is the first tool that utilizes partial sketches and searches for screens in an interactive iterative way. PSDoodle supports different drawing styles and retrieves search results that are relevant to the user's sketch query. A short video demonstration is available online at: https://youtu.be/3cVLHFm5pY4


title: Region Rebalance for Long-Tailed Semantic Segmentation

abstract: In this paper, we study the problem of class imbalance in semantic segmentation. We first investigate and identify the main challenges of addressing this issue through pixel rebalance. Then a simple and yet effective region rebalance scheme is derived based on our analysis. In our solution, pixel features belonging to the same class are grouped into region features, and a rebalanced region classifier is applied via an auxiliary region rebalance branch during training. To verify the flexibility and effectiveness of our method, we apply the region rebalance module into various semantic segmentation methods, such as Deeplabv3+, OCRNet, and Swin. Our strategy achieves consistent improvement on the challenging ADE20K and COCO-Stuff benchmark. In particular, with the proposed region rebalance scheme, state-of-the-art BEiT receives +0.7% gain in terms of mIoU on the ADE20K val set.


title: Streaming Algorithms for Multitasking Scheduling with Shared Processing

abstract: In this paper, we design the first streaming algorithms for the problem of multitasking scheduling on parallel machines with shared processing. In one pass, our streaming approximation schemes can provide an approximate value of the optimal makespan. If the jobs can be read in two passes, the algorithm can find the schedule with the approximate value. This work not only provides an algorithmic big data solution for the studied problem, but also gives an insight into the design of streaming algorithms for other problems in the area of scheduling.


title: Non-Local Latent Relation Distillation for Self-Adaptive 3D Human Pose Estimation

abstract: Available 3D human pose estimation approaches leverage different forms of strong (2D/3D pose) or weak (multi-view or depth) paired supervision. Barring synthetic or in-studio domains, acquiring such supervision for each new target environment is highly inconvenient. To this end, we cast 3D pose learning as a self-supervised adaptation problem that aims to transfer the task knowledge from a labeled source domain to a completely unpaired target. We propose to infer image-to-pose via two explicit mappings viz. image-to-latent and latent-to-pose where the latter is a pre-learned decoder obtained from a prior-enforcing generative adversarial auto-encoder. Next, we introduce relation distillation as a means to align the unpaired cross-modal samples i.e. the unpaired target videos and unpaired 3D pose sequences. To this end, we propose a new set of non-local relations in order to characterize long-range latent pose interactions unlike general contrastive relations where positive couplings are limited to a local neighborhood structure. Further, we provide an objective way to quantify non-localness in order to select the most effective relation set. We evaluate different self-adaptation settings and demonstrate state-of-the-art 3D human pose estimation performance on standard benchmarks.


title: Surrogate model for gravitational wave signals from non-spinning, comparable- to large-mass-ratio black hole binaries built on black hole perturbation theory waveforms calibrated to numerical relativity

abstract: We present a reduced-order surrogate model of gravitational waveforms from non-spinning binary black hole systems with comparable to large mass-ratio configurations. This surrogate model, \texttt{BHPTNRSur1dq1e4}, is trained on waveform data generated by point-particle black hole perturbation theory (ppBHPT) with mass ratios varying from 2.5 to 10,000. \texttt{BHPTNRSur1dq1e4} extends an earlier waveform model, \texttt{EMRISur1dq1e4}, by using an updated transition-to-plunge model, covering longer durations up to 30,500 $m_1$ (where $m_1$ is the mass of the primary black hole), includes several more spherical harmonic modes up to $\ell=10$, and calibrates subdominant modes to numerical relativity (NR) data. In the comparable mass-ratio regime, including mass ratios as low as $2.5$, the gravitational waveforms generated through ppBHPT agree surprisingly well with those from NR after this simple calibration step. We also compare our model to recent SXS and RIT NR simulations at mass ratios ranging from $15$ to $32$, and find the dominant quadrupolar modes agree to better than $\approx 10^{-3}$. We expect our model to be useful to study intermediate-mass-ratio binary systems in current and future gravitational-wave detectors.


title: M2-branes and plane partitions

abstract: There is a correspondence between the protected local operators in the 3d SCFTs describing the geometry $\mathbb{C}^2$ probed by a stack of $N$ M2-branes and plane partitions of trace $N$. We give combinatorial expressions of the indices which count the local operators parametrizing $\mathbb{C}^2/\mathbb{Z}_k$ probed by $N$ M2-branes in the canonical and grand canonical ensembles in terms of generating functions for plane partitions. We derive the asymptotic behaviors of the grand potential in the high-temperature limit and the scaling dimension in the large $N$ limit.


title: Microtransit adoption in the wake of the COVID-19 pandemic: evidence from a choice experiment with transit and car commuters

abstract: On-demand mobility platforms play an increasingly important role in urban mobility systems. Impacts are still debated, as these platforms supply personalized and optimized services, while also contributing to existing sustainability challenges. Recently, microtransit services have emerged, promising to combine advantages of pooled on-demand rides with more sustainable fixed-route public transit services. Understanding traveler behavior becomes a primary focus to analyze adoption likelihood and perceptions of different microtransit attributes. The COVID-19 pandemic context adds an additional layer of complexity to analyzing mobility innovation acceptance. This study investigates the potential demand for microtransit options against the background of the pandemic. We use a stated choice experiment to study the decision-making of Israeli public transit and car commuters when offered to use novel microtransit options (sedan vs. passenger van). We investigate the tradeoffs related to traditional fare and travel time attributes, along with microtransit features; namely walking time to pickup location, vehicle sharing, waiting time, minimum advanced reservation time, and shelter at designated boarding locations. Additionally, we analyze two latent constructs: attitudes towards sharing, as well as experiences and risk-perceptions related to the COVID-19 pandemic. We develop Integrated Choice and Latent Variable models to compare the two commuter groups in terms of the likelihood to switch to microtransit, attribute trade-offs, sharing preferences and pandemic impacts. The results reveal high elasticities of several time and COVID effects for car commuters compared to relative insensitivity of transit commuters to the risk of COVID contraction. Moreover, for car commuters, those with strong sharing identities were more likely to be comfortable in COVID risk situations, and to accept microtransit.


title: GAIL-PT: A Generic Intelligent Penetration Testing Framework with Generative Adversarial Imitation Learning

abstract: Penetration testing (PT) is an efficient network testing and vulnerability mining tool by simulating a hacker's attack for valuable information applied in some areas. Compared with manual PT, intelligent PT has become a dominating mainstream due to less time-consuming and lower labor costs. Unfortunately, RL-based PT is still challenged in real exploitation scenarios because the agent's action space is usually high-dimensional discrete, thus leading to algorithm convergence difficulty. Besides, most PT methods still rely on the decisions of security experts. Addressing the challenges, for the first time, we introduce expert knowledge to guide the agent to make better decisions in RL-based PT and propose a Generative Adversarial Imitation Learning-based generic intelligent Penetration testing framework, denoted as GAIL-PT, to solve the problems of higher labor costs due to the involvement of security experts and high-dimensional discrete action space. Specifically, first, we manually collect the state-action pairs to construct an expert knowledge base when the pre-trained RL / DRL model executes successful penetration testings. Second, we input the expert knowledge and the state-action pairs generated online by the different RL / DRL models into the discriminator of GAIL for training. At last, we apply the output reward of the discriminator to guide the agent to perform the action with a higher penetration success rate to improve PT's performance. Extensive experiments conducted on the real target host and simulated network scenarios show that GAIL-PT achieves the SOTA penetration performance against DeepExploit in exploiting actual target Metasploitable2 and Q-learning in optimizing penetration path, not only in small-scale with or without honey-pot network environments but also in the large-scale virtual network environment.


title: Streaming Approximation Scheme for Minimizing Total Completion Time on Parallel Machines Subject to Varying Processing Capacity

abstract: We study the problem of minimizing total completion time on parallel machines subject to varying processing capacity. In this paper, we develop an approximation scheme for the problem under the data stream model where the input data is massive and cannot fit into memory and thus can only be scanned for a few passes. Our algorithm can compute the approximate value of the optimal total completion time in one pass and output the schedule with the approximate value in two passes.


title: Audio-visual multi-channel speech separation, dereverberation and recognition

abstract: Despite the rapid advance of automatic speech recognition (ASR) technologies, accurate recognition of cocktail party speech characterised by the interference from overlapping speakers, background noise and room reverberation remains a highly challenging task to date. Motivated by the invariance of visual modality to acoustic signal corruption, audio-visual speech enhancement techniques have been developed, although predominantly targeting overlapping speech separation and recognition tasks. In this paper, an audio-visual multi-channel speech separation, dereverberation and recognition approach featuring a full incorporation of visual information into all three stages of the system is proposed. The advantage of the additional visual modality over using audio only is demonstrated on two neural dereverberation approaches based on DNN-WPE and spectral mapping respectively. The learning cost function mismatch between the separation and dereverberation models and their integration with the back-end recognition system is minimised using fine-tuning on the MSE and LF-MMI criteria. Experiments conducted on the LRS2 dataset suggest that the proposed audio-visual multi-channel speech separation, dereverberation and recognition system outperforms the baseline audio-visual multi-channel speech separation and recognition system containing no dereverberation module by a statistically significant word error rate (WER) reduction of 2.06% absolute (8.77% relative).


title: Exploring vortex formation in rotating Bose-Einstein condensates beyond mean-field regime

abstract: The production of quantized vortices having diverse structures is a remarkable effect of rotating Bose-Einstein condensates. Vortex formation described by the mean-field theory is valid only in the regime of weak interactions. The exploration of the rich and diverse physics of strongly interacting BEC requires a more general approach. This study explores the vortex formation of strongly interacting and rapidly rotating BEC from a general ab initio many-body perspective. We demonstrate that the quantized vortices form various structures that emerge from an intricate interplay between the angular momentum and many-body interaction. We examine the distinct impact of the angular velocity and interaction energy on the vortex formation. Our analysis shows that, while the angular rotation generally augments the vortex formation, the interactions can enhance as well as impede the vortices production.


title: Multi-Weight Respecification of Scan-specific Learning for Parallel Imaging

abstract: Parallel imaging is widely used in magnetic resonance imaging as an acceleration technology. Traditional linear reconstruction methods in parallel imaging often suffer from noise amplification. Recently, a non-linear robust artificial-neural-network for k-space interpolation (RAKI) exhibits superior noise resilience over other linear methods. However, RAKI performs poorly at high acceleration rates, and needs a large amount of autocalibration signals as the training samples. In order to tackle these issues, we propose a multi-weight method that implements multiple weighting matrices on the undersampled data, named as MW-RAKI. Enforcing multiple weighted matrices on the measurements can effectively reduce the influence of noise and increase the data constraints. Furthermore, we incorporate the strategy of multiple weighting matrixes into a residual version of RAKI, and form MW-rRAKI.Experimental compari-sons with the alternative methods demonstrated noticeably better reconstruction performances, particularly at high acceleration rates.


title: Some explicit estimates for the error term in the prime number theorem

abstract: By combining and improving recent techniques and results, we provide explicit estimates for the error terms $|\pi(x)-\text{li}(x)|$, $|\theta(x)-x|$ and $|\psi(x)-x|$ appearing in the prime number theorem. For example, we show for all $x\geq 2$ that $|\psi(x)-x|\leq 9.39x(\log x)^{1.515}\exp(-0.8274\sqrt{\log x})$. Our estimates rely heavily on explicit zero-free regions and zero-density estimates for the Riemann zeta-function, and improve on existing bounds for prime-counting functions for large values of $x$.


title: Unsupervised Data Selection via Discrete Speech Representation for ASR

abstract: Self-supervised learning of speech representations has achieved impressive results in improving automatic speech recognition (ASR). In this paper, we show that data selection is important for self-supervised learning. We propose a simple and effective unsupervised data selection method which selects acoustically similar speech to a target domain. It takes the discrete speech representation available in common self-supervised learning frameworks as input, and applies a contrastive data selection method on the discrete tokens. Through extensive empirical studies we show that our proposed method reduces the amount of required pre-training data and improves the downstream ASR performance. Pre-training on a selected subset of 6% of the general data pool results in 11.8% relative improvements in LibriSpeech test-other compared to pre-training on the full set. On Multilingual LibriSpeech French, German, and Spanish test sets, selecting 6% data for pre-training reduces word error rate by more than 15% relatively compared to the full set, and achieves competitive results compared to current state-of-the-art performances.


title: Gauging the R-symmetry of old-minimal $R+R^2$ supergravity

abstract: Old-minimal $R+R^2$ supergravity has a $U(1)$ R-symmetry which rotates the chiral curvature superfield. We gauge this R-symmetry and study new interactions involving the gauge multiplet in the context of inflation and supersymmetry breaking. We construct models where supersymmetry and the R-symmetry are spontaneously broken during and after Starobinsky inflation, and one-loop gauge anomalies are cancelled by the Green--Schwarz mechanism which can also generate Standard Model gaugino masses. The hierarchy between the auxiliary fields, $\langle F\rangle\gtrsim\langle D\rangle$, leads to split mass spectrum where the chiral multiplet masses are around the inflationary scale ($10^{13}$ GeV), while the gauge multiplet masses can be arbitrarily small.


title: The Boundary Term in Huisken's Monotonicity Formula and the Entropy of Translators

abstract: For a manifold-with-boundary moving by mean curvature flow, the entropy at a later time is bounded by the entropy at an earlier time plus a boundary term. This paper controls the boundary term in a geometrically natural way. In particular, it shows (under mild hypotheses)that the entropy of a compact translator is less than or equal to the entropy of the boundary plus the maximal cone density of the boundary.


title: Collective unitary evolution with linear optics by Cartan decomposition

abstract: Unitary operation is an essential step for quantum information processing. We first propose an iterative procedure for decomposing a general unitary operation without resorting to controlled-NOT gate and single-qubit rotation library. Based on the results of decomposition, we design two compact architectures to deterministically implement arbitrary two-qubit polarization-spatial and spatial-polarization collective unitary operations, respectively. The involved linear optical elements are reduced from 25 to 20 and 21 to 20, respectively. Moreover, the parameterized quantum computation can be flexibly manipulated by wave plates and phase shifters. As an application, we construct the specific quantum circuits to realize two-dimensional quantum walk and quantum Fourier transformation. Our schemes are simple and feasible with the current technology.


title: Mock-integrability and stable solitary vortices

abstract: Localized soliton-like solutions to a $(2+1)$-dimensional hydro-dynamical evolution equation are studied numerically. The equation is so-called Williams-Yamagata-Flierl equation, which governs geostrophic fluid in a certain parameter range. Although the equation does not have an integrable structure in the ordinary sense, we find there exist shape-keeping solutions with very long life in a special background flow and an initial condition. The stability of the localization at the fusion process of two soliton-like objects is also investigated. As for the indicator of the long-term stability of localization, we propose a concept of configurational entropy, which has been introduced in analysis for non-topological solitons in field theories.

categories: math-ph hep-th math.MP nlin.SI physics.flu-dyn


title: On the Computational Consequences of Cost Function Design in Nonlinear Optimal Control

abstract: Optimal control is an essential tool for stabilizing complex nonlinear systems. However, despite the extensive impacts of methods such as receding horizon control, dynamic programming and reinforcement learning, the design of cost functions for a particular system often remains a heuristic-driven process of trial and error. In this paper we seek to gain insights into how the choice of cost function interacts with the underlying structure of the control system and impacts the amount of computation required to obtain a stabilizing controller. We treat the cost design problem as a two-step process where the designer specifies outputs for the system that are to be penalized and then modulates the relative weighting of the inputs and the outputs in the cost. To characterize the computational burden associated to obtaining a stabilizing controller with a particular cost, we bound the prediction horizon required by receding horizon methods and the number of iterations required by dynamic programming methods to meet this requirement. Our theoretical results highlight a qualitative separation between what is possible, from a design perspective, when the chosen outputs induce either minimum-phase or non-minimum-phase behavior. Simulation studies indicate that this separation also holds for modern reinforcement learning methods.


title: An End-to-End Integrated Computation and Communication Architecture for Goal-oriented Networking: A Perspective on Live Surveillance Video

abstract: Real-time video surveillance has become a crucial technology for smart cities, made possible through the large-scale deployment of mobile and fixed video cameras. In this paper, we propose situation-aware streaming, for real-time identification of important events from live-feeds at the source rather than a cloud based analysis. For this, we first identify the frames containing a specific situation and assign them a high scale-of-importance (SI). The identification is made at the source using a tiny neural network (having a small number of hidden layers), which incurs a small computational resource, albeit at the cost of accuracy. The frames with a high SI value are then streamed with a certain required Signal-to-Noise-Ratio (SNR) to retain the frame quality, while the remaining ones are transmitted with a small SNR. The received frames are then analyzed using a deep neural network (with many hidden layers) to extract the situation accurately. We show that the proposed scheme is able to reduce the required power consumption of the transmitter by 38.5% for 2160p (UHD) video, while achieving a classification accuracy of 97.5%, for the given situation.


title: Tunnel Barrier to Spin Filter: Electronic Transport Characteristics of Transition Metal Atom Encapsulated in Smallest Cadmium Telluride Cage

abstract: We report first principles theory-based comparative electronic transport studies performed for an atomic chain of Au, bare Cd9Te9 cage-like cluster and single transition metal (TM) (Ti, V, Cr, Mn, Fe, Co, Ni, Cu, Zn, Ru, Rh, Pd) atom encapsulated within the Cd9Te9 using Au(111) as electrodes. The bare cluster is semiconducting and acts as a tunnel barrier up to a particular applied bias and beyond that, the device has a linear current-voltage relationship. Several TM (Ti, V, Cr, Mn, Fe) encapsulated in the cage show half-metallic behavior and spin filtering effect in the I-V characteristics of the device. A detailed qualitative and quantitative analysis of I-V characteristics for metallic, semiconducting, and half-metallic nanostructures has been carried out.


title: Bulk reconstruction from a scalar CFT at the boundary by the smearing with the flow equation

abstract: We explain our proposal for an alternative bulk reconstruction of AdS/CFT correspondences from a scalar field by the flow method. By smearing and then normalizing a primary field in a $d$ dimensional CFT, we construct a bulk field, through which a $d+1$ dimensional AdS space emerges.


title: A new approach to the genus spectra of abelian $p$-groups

abstract: Given a finite group $G$, the {\it genus spetrum} ${\rm sp}(G)$ of $G$ is the set of integers $g\geq 0$ such that $G$ can act faithfully on an orientable closed surface of genus $g$ by orientation-preserving homeomorphisms. The determination of ${\rm sp}(G)$ is a classical topic and has a long history, but progress is lacked. In this paper, when $G$ is an abelian $p$-group with $p>2$, we propose a new approach to ${\rm sp}(G)$, giving a structural description for ${\rm sp}(G)$ in terms of a function which can be computed in finitely many steps.


title: A generalized ACK structure and the denseness of norm attaining operators

abstract: Inspired by the recent work of Cascales et al., we introduce a generalized concept of ACK structure on Banach spaces. Using this property, which we call by the quasi-ACK structure, we are able to extend known universal properties on range spaces concerning the density of norm attaining operators. We provide sufficient conditions for quasi-ACK structure of spaces and results on the stability of quasi-ACK structure. As a consequence, we present new examples satisfying the (Lindenstrauss) property B$^k$, which have not been known previously. We also prove that property B$^k$ is stable under injective tensor products in certain cases. Moreover, ACK structure of some Banach spaces of vector-valued holomorphic functions is also discussed, leading to new examples of universal BPB range spaces for certain operator ideals.


title: Snowmass2021 Cosmic Frontier White Paper: Enabling Flagship Dark Energy Experiments to Reach their Full Potential

abstract: A new generation of powerful dark energy experiments will open new vistas for cosmology in the next decade. However, these projects cannot reach their utmost potential without data from other telescopes. This white paper focuses in particular on the compelling benefits of ground-based spectroscopic and photometric observations to complement the Vera C. Rubin Observatory, as well as smaller programs in aid of a DESI-2 experiment and CMB-S4. These additional data sets will both improve dark energy constraints from these flagship projects beyond what would possible on their own and open completely new windows into fundamental physics. For example, additional photometry and single-object spectroscopy will provide necessary follow-up information for supernova and strong lensing cosmology, while highly-multiplexed spectroscopy both from smaller facilities over wide fields and from larger facilities over narrower regions of sky will yield more accurate photometric redshift estimates for weak lensing and galaxy clustering measurements from the Rubin Observatory, provide critical spectroscopic host galaxy redshifts for supernova Hubble diagrams, provide improved understanding of limiting astrophysical systematic effects, and enable new measurements that probe the nature of gravity. A common thread is that access to complementary data from a range of telescopes/instruments would have a substantial impact on the rate of advance of dark energy science in the coming years.


title: Exploring Mechanisms of Hydration and Carbonation of MgO and Mg(OH)2 in Reactive Magnesium Oxide-based Cements

abstract: Reactive magnesium oxide (MgO)-based cement (RMC) can play a key role in carbon capture processes. However, knowledge on the driving forces that control the degree of carbonation and hydration and rate of reactions in this system remains limited. In this work, density functional theory-based simulations are used to investigate the physical nature of the reactions taking place during the fabrication of RMCs under ambient conditions. Parametric indicators such as adsorption energies, charge transfer, electron localization function, adsorption/dissociation energy barriers and the mechanisms of interaction of H2O and CO2 molecules with MgO and brucite (Mg(OH)2) clusters are considered. The following hydration and carbonation interactions relevant to RMCs are evaluated i) carbonation of MgO, ii) hydration of MgO, carbonation of hydrated MgO, iii) carbonation of Mg(OH)2, iv) hydration of Mg(OH)2 and v) hydration of carbonated Mg(OH)2. A comparison of the energy barriers and reaction pathways of these mechanisms shows that the carbonation of MgO is hindered by presence of H2O molecules, while the carbonation of Mg(OH)2 is hindered by the formation of initial carbonate and hydrate layers as well as presence of excessed H2O molecules. To compare these finding to bulk mineral surfaces, the interactions of the CO2 and H2O molecules with the MgO(001) and Mg(OH)2 (001) surfaces are studied. Therefore, this work presents deep insights into the physical nature of the reactions and the mechanisms involved in hydrated magnesium carbonates production that can be beneficial for its development.


title: Towards Security-Optimized Placement of ADS-B Sensors

abstract: Automatic Dependent Surveillance Broadcast (ADS-B) sensors deployed on the ground are central to observing aerial movements of aircraft. Their unsystematic placement, however, results in over-densification of sensor coverage in some areas and insufficient sensor coverage in other areas. ADS-B sensor coverage has so far been recognized and analyzed as an availability problem; it was tackled by sensor placement optimization techniques that aim for covering large enough areas. In this paper, we demonstrate that the unsystematic placement of ADS-B sensors leads to a security problem, since the realization and possible deployment of protective mechanisms is closely linked to aspects of redundancy in ADS-B sensor coverage. In particular, we model ADS-B sensor coverage as a multi-dimensional security problem. We then use multi-objective optimization techniques to tackle this problem and derive security-optimized near-optimal placement solutions. Our results show how the location of sensors play a significant role in reducing the success rate of attackers by providing a sufficient number of sensors within a specific geographical area to verify location claims and reducing the exposure to jamming attacks.


title: Applications of the dynamical generator coordinate method to quadrupole excitations

abstract: We apply the dynamical generator coordinate method (DGCM) with a conjugate momentum to a nuclear collective excitation. To this end, we first discuss how to construct a numerically workable scheme of the DGCM for a general one-body operator. We then apply the DGCM to the quadrupole vibration of $^{16}$O using the Gogny D1S interaction. We show that both the ground state energy and the excitation energies are lowered as compared to the conventional GCM with the same number of basis functions. We also compute the sum rule values for the quadrupole and monopole operators, and show that the DGCM yields more consistent results than the conventional GCM to the values from the double commutator. These results imply that the conjugate momentum is an important and relevant degree of freedom in collective motions.


title: Global Mapping of Surface Composition on an Exo-Earth Using Sparse Modeling

abstract: The time series of light reflected from exoplanets by future direct imaging can provide spatial information with respect to the planetary surface. We apply sparse modeling to the retrieval method that disentangles the spatial and spectral information from multi-band reflected light curves termed as spin-orbit unmixing. We use the $\ell_1$-norm and the Total Squared Variation norm as regularization terms for the surface distribution. Applying our technique to a toy model of cloudless Earth, we show that our method can infer sparse and continuous surface distributions and also unmixed spectra without prior knowledge of the planet surface. We also apply the technique to the real Earth data as observed by DSCOVR/EPIC. We determined the representative components that can be interpreted as cloud and ocean. Additionally, we found two components that resembled the distribution of land. One of the components captures the Sahara Desert, and the other roughly corresponds to vegetation although their spectra are still contaminated by clouds. Sparse modeling significantly improves the geographic retrieval, in particular, of cloud and leads to higher resolutions for other components when compared with spin-orbit unmixing using Tikhonov regularization.


title: On $n$-universal quadratic forms over dyadic local fields

abstract: Let $ n \ge 2$ be an integer. We give necessary and sufficient conditions for an integral quadratic form over dyadic local fields to be $ n $-universal by using invariants from Beli's theory of bases of norm generators. Also, we provide a minimal set for testing $ n $-universal quadratic forms over dyadic local fields, as an analogue of Bhargava and Hanke's 290-theorem (or Conway and Schneeberger's 15-theorem) on universal quadratic forms with integer coefficients.


title: Parton energy loss at LHC tests for a strongly coupled medium

abstract: We construct a measure of transverse momentum loss of jets in nuclear collisions at LHC directly using measurements of jet cross sections in PbPb and pp collisions. The proposal is shown to be equivalent to R_AA and is equally straightforward to construct. Using data from the ATLAS collaboration at two different collision energies, we show that the proposed measure has small statistical uncertainties. We argue that systematic errors can be easily improved over our estimates by the experimental collaboration to such an extent that it directly probes whether the jet-medium interaction is due to a strongly interacting medium or a weakly interacting plasma. We argue that the current data may marginally favour a strongly interacting medium. On the other hand, assuming that the medium is weakly interacting, we are able to provide estimates of the jet quenching parameter qhat which are in rough agreement with previously reported estimates.


title: Anti-chiral order and spin reorientation transitions of triangle-based antiferromagnets

abstract: We show that triangle-based antiferromagnets with "anti-chiral" order display a non-trivial dependence of the spin orientation with an in-plane field. The spins evolve from rotating in the opposite sense to the field at very low fields to rotating in the same sense as the field above some critical field scale. In the latter regime the system displays first order transitions at which the spin angles jump, and these first order lines terminate in critical points in the Ising universality class. Application to Mn$_3$Sn is discussed.


title: The COVMis-Stance dataset: Stance Detection on Twitter for COVID-19 Misinformation

abstract: During the COVID-19 pandemic, large amounts of COVID-19 misinformation are spreading on social media. We are interested in the stance of Twitter users towards COVID-19 misinformation. However, due to the relative recent nature of the pandemic, only a few stance detection datasets fit our task. We have constructed a new stance dataset consisting of 2631 tweets annotated with the stance towards COVID-19 misinformation. In contexts with limited labeled data, we fine-tune our models by leveraging the MNLI dataset and two existing stance detection datasets (RumourEval and COVIDLies), and evaluate the model performance on our dataset. Our experimental results show that the model performs the best when fine-tuned sequentially on the MNLI dataset and the combination of the undersampled RumourEval and COVIDLies datasets. Our code and dataset are publicly available at https://github.com/yanfangh/covid-rumor-stance


title: Compute- and Data-Intensive Networks: The Key to the Metaverse

abstract: The worlds of computing, communication, and storage have for a long time been treated separately, and even the recent trends of cloud computing, distributed computing, and mobile edge computing have not fundamentally changed the role of networks, still designed to move data between end users and pre-determined computation nodes, without true optimization of the end-to-end compute-communication process. However, the emergence of Metaverse applications, where users consume multimedia experiences that result from the real-time combination of distributed live sources and stored digital assets, has changed the requirements for, and possibilities of, systems that provide distributed caching, computation, and communication. We argue that the real-time interactive nature and high demands on data storage, streaming rates, and processing power of Metaverse applications will accelerate the merging of the cloud into the network, leading to highly-distributed tightly-integrated compute- and data-intensive networks becoming universal compute platforms for next-generation digital experiences. In this paper, we first describe the requirements of Metaverse applications and associated supporting infrastructure, including relevant use cases. We then outline a comprehensive cloud network flow mathematical framework, designed for the end-to-end optimization and control of such systems, and show numerical results illustrating its promising role for the efficient operation of Metaverse-ready networks.


title: Micro-Behavior Encoding for Session-based Recommendation

abstract: Session-based Recommendation (SR) aims to predict the next item for recommendation based on previously recorded sessions of user interaction. The majority of existing approaches to SR focus on modeling the transition patterns of items. In such models, the so-called micro-behaviors describing how the user locates an item and carries out various activities on it (e.g., click, add-to-cart, and read-comments), are simply ignored. A few recent studies have tried to incorporate the sequential patterns of micro-behaviors into SR models. However, those sequential models still cannot effectively capture all the inherent interdependencies between micro-behavior operations. In this work, we aim to investigate the effects of the micro-behavior information in SR systematically. Specifically, we identify two different patterns of micro-behaviors: "sequential patterns" and "dyadic relational patterns". To build a unified model of user micro-behaviors, we first devise a multigraph to aggregate the sequential patterns from different items via a graph neural network, and then utilize an extended self-attention network to exploit the pair-wise relational patterns of micro-behaviors. Extensive experiments on three public real-world datasets show the superiority of the proposed approach over the state-of-theart baselines and confirm the usefulness of these two different micro-behavior patterns for SR.


title: Ordinal Optimization Through Multi-objective Reformulation

abstract: We analyze combinatorial optimization problems with ordinal, i.e., non-additive, objective functions that assign categories (like good, medium and bad) rather than cost coefficients to the elements of feasible solutions. We review different optimality concepts for ordinal optimization problems and discuss their similarities and differences. We then focus on two prevalent optimality concepts that are shown to be equivalent. Our main result is a bijective linear transformation that transforms ordinal optimization problems to associated standard multi-objective optimization problems with binary cost coefficients. Since this transformation preserves all properties of the underlying problem, problem-specific solution methods remain applicable. A prominent example is dynamic programming and Bellman's principle of optimality, that can be applied, e.g., to ordinal shortest path and ordinal knapsack problems. We extend our results to multi-objective optimization problems that combine ordinal and real-valued objective functions.


title: Bimodal Distributed Binarized Neural Networks

abstract: Binary Neural Networks (BNNs) are an extremely promising method to reduce deep neural networks' complexity and power consumption massively. Binarization techniques, however, suffer from ineligible performance degradation compared to their full-precision counterparts. Prior work mainly focused on strategies for sign function approximation during forward and backward phases to reduce the quantization error during the binarization process. In this work, we propose a Bi-Modal Distributed binarization method (\methodname{}). That imposes bi-modal distribution of the network weights by kurtosis regularization. The proposed method consists of a training scheme that we call Weight Distribution Mimicking (WDM), which efficiently imitates the full-precision network weight distribution to their binary counterpart. Preserving this distribution during binarization-aware training creates robust and informative binary feature maps and significantly reduces the generalization error of the BNN. Extensive evaluations on CIFAR-10 and ImageNet demonstrate the superiority of our method over current state-of-the-art schemes. Our source code, experimental settings, training logs, and binary models are available at \url{https://github.com/BlueAnon/BD-BNN}.


title: Aerial Computing: A New Computing Paradigm, Applications, and Challenges

abstract: In existing computing systems, such as edge computing and cloud computing, several emerging applications and practical scenarios are mostly unavailable or only partially implemented. To overcome the limitations that restrict such applications, the development of a comprehensive computing paradigm has garnered attention in both academia and industry. However, a gap exists in the literature owing to the scarce research, and a comprehensive computing paradigm is yet to be systematically designed and reviewed. This study introduces a novel concept, called aerial computing, via the amalgamation of aerial radio access networks and edge computing, which attempts to bridge the gap. Specifically, first, we propose a novel comprehensive computing architecture that is composed of low-altitude computing, high-altitude computing, and satellite computing platforms, along with conventional computing systems. We determine that aerial computing offers several desirable attributes: global computing service, better mobility, higher scalability and availability, and simultaneity. Second, we comprehensively discuss key technologies that facilitate aerial computing, including energy refilling, edge computing, network softwarization, frequency spectrum, multi-access techniques, artificial intelligence, and big data. In addition, we discuss vertical domain applications (e.g., smart cities, smart vehicles, smart factories, and smart grids) supported by aerial computing. Finally, we highlight several challenges that need to be addressed and their possible solutions.


title: Octupole correlations in collective excitations of neutron-rich $N\approx56$ nuclei

abstract: Octupole correlations in the low-energy collective states of neutron-rich nuclei with the neutron number $N\approx56$ are studied within the interacting boson model (IBM) that is based on the nuclear density functional theory. The constrained self-consistent mean-field (SCMF) calculations using a universal energy density functional and a pairing interaction provide the potential energy surfaces in terms of the axially-symmetric quadrupole and octupole deformations for the even-even nuclei $^{86-94}$Se, $^{88-96}$Kr, $^{90-98}$Sr, $^{92-100}$Zr, and $^{94-102}$Mo. The SCMF energy surface is then mapped onto the energy expectation value of a version of the IBM in the boson condensate state, which consists of the neutron and proton monopole $s$, quadrupole $d$, and octupole $f$ bosons. This procedure determines the strength parameters of the IBM Hamiltonian, which is used to compute relevant spectroscopic properties. At the SCMF level, no octupole deformed ground state is obtained, while the energy surface is generally soft in the octupole deformation at $N\approx56$. The predicted negative-parity yrast bands with the bandhead state $3^-_1$ weakly depend on $N$ and become lowest in energy at $N=56$ in each of the considered isotopic chains. The model further predicts finite electric octupole transition rates between the lowest negative- and the positive-parity ground-state bands.


title: Fact Checking with Insufficient Evidence

abstract: Automating the fact checking (FC) process relies on information obtained from external sources. In this work, we posit that it is crucial for FC models to make veracity predictions only when there is sufficient evidence and otherwise indicate when it is not enough. To this end, we are the first to study what information FC models consider sufficient by introducing a novel task and advancing it with three main contributions. First, we conduct an in-depth empirical analysis of the task with a new fluency-preserving method for omitting information from the evidence at the constituent and sentence level. We identify when models consider the remaining evidence (in)sufficient for FC, based on three trained models with different Transformer architectures and three FC datasets. Second, we ask annotators whether the omitted evidence was important for FC, resulting in a novel diagnostic dataset, SufficientFacts, for FC with omitted evidence. We find that models are least successful in detecting missing evidence when adverbial modifiers are omitted (21% accuracy), whereas it is easiest for omitted date modifiers (63% accuracy). Finally, we propose a novel data augmentation strategy for contrastive self-learning of missing evidence by employing the proposed omission method combined with tri-training. It improves performance for Evidence Sufficiency Prediction by up to 17.8 F1 score, which in turn improves FC performance by up to 2.6 F1 score.


title: Learning Video Salient Object Detection Progressively from Unlabeled Videos

abstract: Recent deep learning-based video salient object detection (VSOD) has achieved some breakthrough, but these methods rely on expensive annotated videos with pixel-wise annotations, weak annotations, or part of the pixel-wise annotations. In this paper, based on the similarities and the differences between VSOD and image salient object detection (SOD), we propose a novel VSOD method via a progressive framework that locates and segments salient objects in sequence without utilizing any video annotation. To use the knowledge learned in the SOD dataset for VSOD efficiently, we introduce dynamic saliency to compensate for the lack of motion information of SOD during the locating process but retain the same fine segmenting process. Specifically, an algorithm for generating spatiotemporal location labels, which consists of generating high-saliency location labels and tracking salient objects in adjacent frames, is proposed. Based on these location labels, a two-stream locating network that introduces an optical flow branch for video salient object locating is presented. Although our method does not require labeled video at all, the experimental results on five public benchmarks of DAVIS, FBMS, ViSal, VOS, and DAVSOD demonstrate that our proposed method is competitive with fully supervised methods and outperforms the state-of-the-art weakly and unsupervised methods.


title: An extension of Batanin's approach to globular algebras

abstract: In earlier work, Batanin has shown that an important class of definitions of higher categories could be apprehended together simply as monads over globular sets. This allowed him to generalize the notion of polygraph, initially introduced by Street and Burroni for strict categories, to all algebraic globular higher categories. In this work, we refine this perspective and introduce new constructions and properties for this class of higher categories. In particular, we define the notion of cellular extension and its associated free construction, from which we obtain another definition of polygraphs and the adjunction between globular algebras and polygraphs. We moreover introduce two criteria allowing one to use most of the constructions of this article without having to describe explicitly the underlying globular monad.


title: LatentGAN Autoencoder: Learning Disentangled Latent Distribution

abstract: In autoencoder, the encoder generally approximates the latent distribution over the dataset, and the decoder generates samples using this learned latent distribution. There is very little control over the latent vector as using the random latent vector for generation will lead to trivial outputs. This work tries to address this issue by using the LatentGAN generator to directly learn to approximate the latent distribution of the autoencoder and show meaningful results on MNIST, 3D Chair, and CelebA datasets, an additional information-theoretic constrain is used which successfully learns to control autoencoder latent distribution. With this, our model also achieves an error rate of 2.38 on MNIST unsupervised image classification, which is better as compared to InfoGAN and AAE.


title: ELECRec: Training Sequential Recommenders as Discriminators

abstract: Sequential recommendation is often considered as a generative task, i.e., training a sequential encoder to generate the next item of a user's interests based on her historical interacted items. Despite their prevalence, these methods usually require training with more meaningful samples to be effective, which otherwise will lead to a poorly trained model. In this work, we propose to train the sequential recommenders as discriminators rather than generators. Instead of predicting the next item, our method trains a discriminator to distinguish if a sampled item is a 'real' target item or not. A generator, as an auxiliary model, is trained jointly with the discriminator to sample plausible alternative next items and will be thrown out after training. The trained discriminator is considered as the final SR model and denoted as \modelname. Experiments conducted on four datasets demonstrate the effectiveness and efficiency of the proposed approach.


title: Mean value theorems for the Apostol-Vu double zeta-function and its application

abstract: In this paper, we obtain mean square values of the double zeta-functions of the Apostol-Vu type and the Mordell-Tornheim type.


title: RL4ReAl: Reinforcement Learning for Register Allocation

abstract: We aim to automate decades of research and experience in register allocation, leveraging machine learning. We tackle this problem by embedding a multi-agent reinforcement learning algorithm within LLVM, training it with the state of the art techniques. We formalize the constraints that precisely define the problem for a given instruction-set architecture, while ensuring that the generated code preserves semantic correctness. We also develop a gRPC based framework providing a modular and efficient compiler interface for training and inference. Our approach is architecture independent: we show experimental results targeting Intel x86 and ARM AArch64. Our results match or out-perform the heavily tuned, production-grade register allocators of LLVM.


title: Double lines in the quintic del Pezzo fourfold

abstract: Let $Y$ be the del Pezzo $4$-fold defined by the linear section $\textrm{Gr}(2,5)$ by $\mathbb{P}^7$. In this paper, we classify the type of normal bundles of lines in $Y$ and describe its parameter space. As a corollary, we obtain the desigularized model of the moduli space of stable maps in $Y$. Also we compute the intersection Poincar\'e polynomial of the stable maps space.


title: A novel spectral method for the subdiffusion equation

abstract: In this paper, we design and analyze a novel spectral method for the subdiffusion equation. As it has been known, the solutions of this equation are usually singular near the initial time. Consequently, direct application of the traditional high-order numerical methods is inefficient. We try to overcome this difficulty in a novel approach by combining variable transformation techniques with spectral methods. The idea is to first use suitable variable transformation to re-scale the underlying equation, then construct spectral methods for the re-scaled equation. We establish a new variational framework based on the $\psi$-fractional Sobolev spaces. This allows us to prove the well-posedness of the associated variational problem. The proposed spectral method is based on the variational problem and generalized Jacobi polynomials to approximate the re-scaled fractional differential equation. Our theoretical and numerical investigation show that the proposed method is exponentially convergent for general right hand side functions, even though the exact solution has very limited regularity. Implementation details are also provided, along with a series of numerical examples to show the efficiency of the proposed method.


title: Existence, uniqueness and approximation of solutions to Carath\'eodory delay differential equations

abstract: In this paper we address the existence, uniqueness and approximation of solutions of delay differential equations (DDEs) with Carath\'eodory type right-hand side functions. We provide construction of randomized Euler scheme for DDEs and investigate its error. We also report results of numerical experiments.


title: Systematic KMTNet Planetary Anomaly Search. IV. Complete Sample of 2019 Prime-Field

abstract: We report the complete statistical planetary sample from the prime fields ($\Gamma \geq 2~{\rm hr}^{-1}$) of the 2019 Korea Microlensing Telescope Network (KMTNet) microlensing survey. We develop the optimized KMTNet AnomalyFinder algorithm and apply it to the 2019 KMTNet prime fields. We find a total of 14 homogeneously selected planets and report the analysis of three planetary events, KMT-2019-BLG-(1042,1552,2974). The planet-host mass ratios, $q$, for the three planetary events are $6.34 \times 10^{-4}, 4.89 \times 10^{-3}$ and $6.18 \times 10^{-4}$, respectively. A Bayesian analysis indicates the three planets are all cold giant planets beyond the snow line of their host stars. The 13 planets are basically uniform in $\log q$ over the range $-5.0 < \log q < -1.5$. This result suggests that the planets below $q_{\rm break} = 1.7 \times 10^{-4}$ proposed by the MOA-II survey may be more common than previously believed. This work is an early component of a large project to determine the KMTNet mass-ratio function, and the whole sample of 2016--2019 KMTNet events should contain about 120 planets.


title: A sum-bracket theorem for simple Lie algebras

abstract: Let $\mathfrak{g}$ be an algebra over $K$ with a bilinear operation $[\cdot,\cdot]:\mathfrak{g}\times\mathfrak{g}\rightarrow\mathfrak{g}$ not necessarily associative. For $A\subseteq\mathfrak{g}$, let $A^{k}$ be the set of elements of $\mathfrak{g}$ written combining $k$ elements of $A$ via $+$ and $[\cdot,\cdot]$. We show a "sum-bracket theorem" for simple Lie algebras over $K$ of the form $\mathfrak{g}=\mathfrak{sl}_{n},\mathfrak{so}_{n},\mathfrak{sp}_{2n},\mathfrak{e}_{6},\mathfrak{e}_{7},\mathfrak{e}_{8},\mathfrak{f}_{4},\mathfrak{g}_{2}$: if $\mathrm{char}(K)$ is not too small, we have growth of the form $|A^{k}|\geq|A|^{1+\varepsilon}$ for all generating symmetric sets $A$ away from subfields of $K$. Over $\mathbb{F}_{p}$ in particular, we have a diameter bound matching the best analogous bounds for groups of Lie type [BDH21]. As an independent intermediate result, we prove also an estimate of the form $|A\cap V|\leq|A^{k}|^{\dim(V)/\dim(\mathfrak{g})}$ for linear affine subspaces $V$ of $\mathfrak{g}$. This estimate is valid for all simple algebras, and $k$ is especially small for a large class of them including associative, Lie, and Mal'cev algebras, and Lie superalgebras.


title: Mixing detection on Bitcoin transactions using statistical patterns

abstract: Cryptocurrencies gained lots of attention mainly because of the anonymous way of online payment, which they suggested. Meanwhile, Bitcoin and other major cryptocurrencies have experienced severe deanonymization attacks. To address these attacks, Bitcoin contributors introduced services called mixers or tumblers. Mixing or laundry services aim to return anonymity back to the network. In this research, we tackle the problem of losing the footprint of money in Bitcoin and other cryptocurrencies networks caused by the usage of mixing services. We devise methods to track transactions and addresses of these services and the addresses of dirty and cleaned money. Because of the lack of labeled data, we had to transact with these services and prepare labeled data. Using this data, we found reliable patterns and developed an integrated algorithm to detect mixing transactions, mixing addresses, sender addresses, and receiver addresses in the Bitcoin network.


title: Discriminants of Theta-Representations

abstract: Tevelev has given a remarkable explicit formula for the discriminant of a complex simple Lie algebra, which can be defined as the equation of the dual hypersurface of the minimal nilpotent orbit, or of the so-called adjoint variety. In this paper we extend this formula to the setting of graded Lie algebras, and express the equation of the corresponding dual hypersurfaces in terms of the reflections in the little Weyl groups, the associated complex reflection groups. This explains for example why the codegree of the Grassmannian $G(4, 8)$ is equal to the number of roots of $\mathfrak{e}_7$ .


title: Geodesics in first-passage percolation cross any pattern

abstract: In first-passage percolation, one places nonnegative i.i.d. random variables (T (e)) on the edges of Z d. A geodesic is an optimal path for the passage times T (e). Consider a local property of the time environment. We call it a pattern. We investigate the number of times a geodesic crosses a translate of this pattern. Under mild conditions, we show that, apart from an event with exponentially small probability, this number is linear in the distance between the extremities of the geodesic.


title: Towards Digital Twin-enabled DevOps for CPS providing Architecture-Based Service Adaptation & Verification at Runtime

abstract: Industrial Product-Service Systems (IPSS) denote a service-oriented (SO) way of providing access to CPS capabilities. The design of such systems bears high risk due to uncertainty in requirements related to service function and behavior, operation environments, and evolving customer needs. Such risks and uncertainties are well known in the IT sector, where DevOps principles ensure continuous system improvement through reliable and frequent delivery processes. A modular and SO system architecture complements these processes to facilitate IT system adaptation and evolution. This work proposes a method to use and extend the Digital Twins (DTs) of IPSS assets for enabling the continuous optimization of CPS service delivery and the latter's adaptation to changing needs and environments. This reduces uncertainty during design and operations by assuring IPSS integrity and availability, especially for design and service adaptations at CPS runtime. The method builds on transferring IT DevOps principles to DT-enabled CPS IPSS. The chosen design approach integrates, reuses, and aligns the DT processing and communication resources with DevOps requirements derived from literature. We use these requirements to propose a DT-enabled self-adaptive CPS model, which guides the realization of DT-enabled DevOps in CPS IPSS. We further propose detailed design models for operation-critical DTs that integrate CPS closed-loop control and architecture-based CPS adaptation. This integrated approach enables the implementation of A/B testing as a use case and central concept to enable CPS IPSS service adaptation and reconfiguration. The self-adaptive CPS model and DT design concept have been validated in an evaluation environment for operation-critical CPS IPSS. The demonstrator achieved sub-millisecond cycle times during service A/B testing at runtime without causing CPS operation interferences and downtime.


title: A Complementary Joint Training Approach Using Unpaired Speech and Text for Low-Resource Automatic Speech Recognition

abstract: Unpaired data has shown to be beneficial for low-resource automatic speech recognition~(ASR), which can be involved in the design of hybrid models with multi-task training or language model dependent pre-training. In this work, we leverage unpaired data to train a general sequence-to-sequence model. Unpaired speech and text are used in the form of data pairs by generating the corresponding missing parts in prior to model training. Inspired by the complementarity of speech-PseudoLabel pair and SynthesizedAudio-text pair in both acoustic features and linguistic features, we propose a complementary joint training~(CJT) method that trains a model alternatively with two data pairs. Furthermore, label masking for pseudo-labels and gradient restriction for synthesized audio are proposed to further cope with the deviations from real data, termed as CJT++. Experimental results show that compared to speech-only training, the proposed basic CJT achieves great performance improvements on clean/other test sets, and the CJT++ re-training yields further performance enhancements. It is also apparent that the proposed method outperforms the wav2vec2.0 model with the same model size and beam size, particularly in extreme low-resource cases.


title: Morse-Rad\'o Theory for Minimal Surfaces

abstract: For a class of functions (called minimal Rad\'o functions) that arise naturally in minimal surface theory, we bound the number of interior critical points (counting multiplicity) in terms of the boundary data and the Euler characteristic of the domain of the function.


title: Revisiting Pushchino RRAT search using neural network

abstract: The search for rotating radio transients (RRAT) at declination from -9o to +42o was carried out in the semi-annual monitoring data obtained on the Large Phased Array (LPA) radio telescope at the frequency of 111 MHz. A neural network was used to search for candidates. 4 new RRATs were detected, having dispersion measures (DM) 5-16 pc/cm3. A comparison with an earlier RRAT search conducted using the same data shows that the neural network reduced the amount of interference by 80 times, down to 1.3% of the initial amount of interferences. The loss of real pulsar pulses does not exceed 6% of their total number.


title: Efficiency of Penrose process in spacetime of axially symmetric magnetized Reissner-Nordstr\"{o}m black hole

abstract: In this paper, we investigate the Penrose process in the purlieus of the axially symmetric magnetized Reissner-Nordstr\"{o}m black hole for both neutral and charged particles. We start with the study of the geometry of the black hole and find the regions where the $g_{tt}$ component of the metric tensor is positive (i.e., $g_{tt}>0$). It is interestingly found that the condition $g_{tt}>0$ is fulfilled not only close to the event horizon known as the ergosphere but also far away from the event horizon in the silhouette of potential wells. We also show that as the dimensionless magnetic field $B$ increases the silhouette of potential wells for which $g_{tt}>0$ grows correspondingly and eventually merges with the ergoregion when $B\gtrsim 1.6$. Finally, we investigate the efficiency of the Penrose process for the axially symmetric magnetized black hole case and bring out the effect of the magnetic field on it. Further, we also compare our results with the one for Kerr black hole. We show that when the charge $Q$ of the black hole is kept constant, the efficiency of the energy extraction process for the case of {a neutral particle (i.e., $q/m=0$) first increases and then begins to decrease with rise in the value of $B$ field, in contrast to Kerr black hole where it always increases as the rotation parameter grows. However, for the case of a charged particle (i.e., $q\neq 0$) the efficiency always increases with the rise in the $B$ field and can go over $100\%$, when both $B$ and $q/m$ are large enough (say $B\approx1$ and $q/m>2.2$)}. It is worth noting that the existence of regions away from the horizon where $g_{tt}>0$ also favors the energy-extraction process away from the effect of the black hole. However, the energy extraction from these regions is pure consequence of the magnetic field.


title: A Survey on Dropout Methods and Experimental Verification in Recommendation

abstract: Overfitting is a common problem in machine learning, which means the model too closely fits the training data while performing poorly in the test data. Among various methods of coping with overfitting, dropout is one of the representative ways. From randomly dropping neurons to dropping neural structures, dropout has achieved great success in improving model performances. Although various dropout methods have been designed and widely applied in past years, their effectiveness, application scenarios, and contributions have not been comprehensively summarized and empirically compared by far. It is the right time to make a comprehensive survey. In this paper, we systematically review previous dropout methods and classify them into three major categories according to the stage where dropout operation is performed. Specifically, more than seventy dropout methods published in top AI conferences or journals (e.g., TKDE, KDD, TheWebConf, SIGIR) are involved. The designed taxonomy is easy to understand and capable of including new dropout methods. Then, we further discuss their application scenarios, connections, and contributions. To verify the effectiveness of distinct dropout methods, extensive experiments are conducted on recommendation scenarios with abundant heterogeneous information. Finally, we propose some open problems and potential research directions about dropout that worth to be further explored.


title: A Generative Deep Learning Approach to Stochastic Downscaling of Precipitation Forecasts

abstract: Despite continuous improvements, precipitation forecasts are still not as accurate and reliable as those of other meteorological variables. A major contributing factor to this is that several key processes affecting precipitation distribution and intensity occur below the resolved scale of global weather models. Generative adversarial networks (GANs) have been demonstrated by the computer vision community to be successful at super-resolution problems, i.e., learning to add fine-scale structure to coarse images. Leinonen et al. (2020) previously applied a GAN to produce ensembles of reconstructed high-resolution atmospheric fields, given coarsened input data. In this paper, we demonstrate this approach can be extended to the more challenging problem of increasing the accuracy and resolution of comparatively low-resolution input from a weather forecasting model, using high-resolution radar measurements as a "ground truth". The neural network must learn to add resolution and structure whilst accounting for non-negligible forecast error. We show that GANs and VAE-GANs can match the statistical properties of state-of-the-art pointwise post-processing methods whilst creating high-resolution, spatially coherent precipitation maps. Our model compares favourably to the best existing downscaling methods in both pixel-wise and pooled CRPS scores, power spectrum information and rank histograms (used to assess calibration). We test our models and show that they perform in a range of scenarios, including heavy rainfall.


title: To reduce soil salinity: the role of irrigation and water management in global arid regions across development phases

abstract: Reducing soil salinization of croplands with optimized irrigation and water management is essential to achieve land degradation neutralization. The effectiveness and sustainability of various irrigation and water management measures to reduce basin-scale salinization remain uncertain. Here we use remote sensing to estimate soil salinity of arid croplands from 1984 to 2018. We then use Bayesian network analysis to compare the spatial-temporal response of salinity to water management, including various irrigation and drainage methods, in ten large arid river basins: Nile, Tigris-Euphrates, Indus, Tarim, Amu, Ili, Syr, Junggar, Colorado, and San Joaquin. Managers in basins at more advanced phases of development implemented drip and groundwater irrigation, which effectively controlled salinity by lowering groundwater levels. For the remaining basins where conventional flood irrigation is used, economic development and policies are crucial to establishing a virtuous circle of improving irrigation systems, reducing salinity, and increasing agricultural incomes necessary to achieve LDN.


title: $\textit{latent}$-GLAT: Glancing at Latent Variables for Parallel Text Generation

abstract: Recently, parallel text generation has received widespread attention due to its success in generation efficiency. Although many advanced techniques are proposed to improve its generation quality, they still need the help of an autoregressive model for training to overcome the one-to-many multi-modal phenomenon in the dataset, limiting their applications. In this paper, we propose $\textit{latent}$-GLAT, which employs the discrete latent variables to capture word categorical information and invoke an advanced curriculum learning technique, alleviating the multi-modality problem. Experiment results show that our method outperforms strong baselines without the help of an autoregressive model, which further broadens the application scenarios of the parallel decoding paradigm.


title: Semi-Nonparametric Estimation of Distribution Divergence in Non-Euclidean Spaces

abstract: This paper explores methods for estimating or approximating the total variation distance and the chi-squared divergence of probability measures within topological sample spaces, using independent and identically distributed samples. Our focus is on the practical scenario where the sample space is homeomorphic to subsets of Euclidean space, with the specific homeomorphism remaining unknown. Our proposed methods rely on the integral probability metric with witness functions in universal reproducing kernel Hilbert spaces (RKHSs). The estimators we develop consist of learnable parametric functions mapping the sample space to Euclidean space, paired with universal kernels defined in Euclidean space. This approach effectively overcomes the challenge of constructing universal kernels directly on non-Euclidean spaces. Furthermore, the estimators we devise demonstrate asymptotic consistency, and we provide a detailed statistical analysis, shedding light on their practical implementation.


title: Built-in scordatura in U-DHOST

abstract: Modified gravity theories can accommodate exact solutions, for which the metric has the same form as the one in general relativity, i.e., stealth solutions. One problem with these stealth solutions is that perturbations around them exhibit strong coupling when the solutions are realized in degenerate higher-order scalar-tensor theories. We show that the strong coupling problem can be circumvented in the framework of the so-called U-DHOST theories, in which the degeneracy is partially broken in such a way that higher-derivative terms are degenerate only in the unitary gauge. In this sense, the scordatura effect is built-in in U-DHOST theories in general. There is an apparent Ostrogradsky mode in U-DHOST theories, but it does not propagate as it satisfies a three-dimensional elliptic differential equation on a spacelike hypersurface. We also clarify how this nonpropagating mode, i.e., the "shadowy" mode shows up at the nonlinear level.


title: Learning to Reduce Information Bottleneck for Object Detection in Aerial Images

abstract: Object detection in aerial images is a fundamental research topic in the geoscience and remote sensing domain. However, the advanced approaches on this topic mainly focus on designing the elaborate backbones or head networks but ignore neck networks. In this letter, we first underline the importance of the neck network in object detection from the perspective of information bottleneck. Then, to alleviate the information deficiency problem in the current approaches, we propose a global semantic network (GSNet), which acts as a bridge from the backbone network to the head network in a bidirectional global pattern. Compared to the existing approaches, our model can capture the rich and enhanced image features with less computational costs. Besides, we further propose a feature fusion refinement module (FRM) for different levels of features, which are suffering from the problem of semantic gap in feature fusion. To demonstrate the effectiveness and efficiency of our approach, experiments are carried out on two challenging and representative aerial image datasets (i.e., DOTA and HRSC2016). Experimental results in terms of accuracy and complexity validate the superiority of our method. The code has been open-sourced at GSNet.


title: Optical Spectral Variations of a Large Sample of Fermi Blazars

abstract: We have investigated the optical spectral behavior of a large sample of Fermi blazars (40 FSRQs and 13 BL Lacs), and found two new universal optical spectral behaviors. In the low state the optical spectrum gradually becomes softer (steeper) or harder (flatter) but more and more slowly when the brightness increases, and then tends to stable in the high state, which are briefly named the redder-stable-when-brighter (RSWB) and bluer-stable-when-brighter (BSWB) behaviors, respectively. 34 FSRQs and 7 BL Lacs exhibit clear RSWB behavior, and 2 FSRQs and 5 BL Lacs show distinct BSWB behavior, which mean that FSRQs favor more RSWB than BSWB behavior, while BL Lacs have no clear preference among both behaviors. We have put forward a unified nonlinear formula to quantitatively characterize the optical spectral behaviors of FSRQs and BL Lacs, which can fit both kinds of behaviors very well. We argue that the RSWB and BSWB behaviors originate from the same mechanism, and they are the universal optical spectral behaviors for blazars. The frequently observed redder-when-brighter (RWB) and bluer-when-brighter (BWB) trends can be considered to be the approximations of the behaviors of RSWB and BSWB, respectively. The rarely observed stable-when-brighter (SWB) trend can also be viewed as an approximation or a special case of the RSWB or BSWB behavior. We have developed a model with two constant-spectral-index components which can not only explain well both two kinds of optical spectral behaviors, but also successfully interpret the differential behaviors between FSRQs and BL Lacs.


title: DT2I: Dense Text-to-Image Generation from Region Descriptions

abstract: Despite astonishing progress, generating realistic images of complex scenes remains a challenging problem. Recently, layout-to-image synthesis approaches have attracted much interest by conditioning the generator on a list of bounding boxes and corresponding class labels. However, previous approaches are very restrictive because the set of labels is fixed a priori. Meanwhile, text-to-image synthesis methods have substantially improved and provide a flexible way for conditional image generation. In this work, we introduce dense text-to-image (DT2I) synthesis as a new task to pave the way toward more intuitive image generation. Furthermore, we propose DTC-GAN, a novel method to generate images from semantically rich region descriptions, and a multi-modal region feature matching loss to encourage semantic image-text matching. Our results demonstrate the capability of our approach to generate plausible images of complex scenes using region captions.


title: Schottky's forgotten step to the Ising model

abstract: A longstanding problem in natural science and later in physics was the understanding of the existence of ferromagnetism and its disappearance under heating to high temperatures. Although a qualitative description was possible by the Curie-Weiss theory it was obvious that a microscopic model was necessary to explain the tendency of the elementary magnetons to prefer parallel ordering at low temperatures. Such a model was proposed in 1922 by W. Schottky within the old Bohr-Sommerfeld quantum mechanics and claimed to explain the high values of the Curie temperatures of certain ferromagnets. Based on this idea Ising formulated a new model for ferromagnetism in solids. Simultaneously the old quantum mechanics was replaced by new concepts of Heisenberg and Schr\"odinger and the discovery of spin. Thus Schottky's idea was outperformed and finally replaced in 1928 by Heisenberg exchange interaction. This led to a reformulation of Ising's model by Pauli at the Solvay conference in 1930. Nevertheless one might consider Schottky's idea as a forerunner of this development explaining and asserting that the main point is the Coulomb energy leading to the essential interaction of neighboring elementary magnets.


title: Tracking interfacial changes of graphene/Ge(110) during in-vacuum annealing

abstract: Graphene quality indicators obtained by Raman spectroscopy have been correlated to the structural changes of the graphene/Germanium interface as a function of in-vacuum thermal annealing. Specifically, it is found that graphene becomes markedly defected at 650 {\deg}C. By combining scanning tunneling microscopy, x-Ray Photoelectron Spectroscopy and Near Edge x-ray Absorption Fine Structure Spectroscopy, we conclude that these defects are due to the release of H_{2} gas trapped at the graphene/Germanium interface. The H_{2} gas was produced following the transition from the as-grown hydrogen-termination of the Ge(110) surface to the emergence of surface reconstructions in the substrate. Interestingly, a complete self-healing process is observed in graphene upon annealing to 800 {\deg}C. The subtle interplay revealed between the microscopic changes occurring at the graphene/Germanium interface and graphene's defect density is valuable for advancing graphene growth, controlled 2D-3D heterogeneous materials interfacing and integrated fabrication technology on semiconductors.