title: Traffic Behavior in Cloud Data Centers: A Survey

abstract: Data centers (DCs) nowadays house tens of thousands of servers and switches, interconnected by high-speed communication links. With the rapid growth of cloud DCs, in both size and number, tremendous efforts have been undertaken to efficiently design the network and manage the traffic within these DCs. However, little effort has been made toward measuring, understanding and chattelizing how the network-level traffic of these DCs behave. In this paper, we aim to present a systematic taxonomy and survey of these DC studies. Specifically, our survey first decomposes DC network traffic behavior into two main stages, namely (1) data collection methodologies and (2) research findings, and then classifies and discusses the recent research studies in each stage. Finally, the survey highlights few research challenges related to DC network traffic that require further research investigation.


title: Configuration entropy and confinement/deconfinement transiton in holographic QCD

abstract: In the holographic AdS/QCD approach, the confinement/deconfinement transition is associated with the Hawking-Page transition of a thermal anti-de Sitter (AdS) space to an AdS black hole. In the case of the hard wall model, the thermal transition takes place in the planar AdS thanks to the introduction of an infrared cut-off in the geometry. The corresponding thermodynamic entropy of the $SU(N) $ gauge theory jumps from proportional to $N^0$ in the confined hadronic phase to proportional to $N^2$ in the plasma phase, corresponding to the presence of the color degrees of freedom. The Hawking-Page transition is understood by considering a semiclassical picture of a system consisting of two different geometries that are asymptotically AdS. One is the AdS black hole and the other the thermal AdS space. The relative stability between these competing geometries varies with the temperature. So, the transition is essentially a problem of stability. An interesting tool to study stability of physical systems is the configuration entropy (CE), inspired in the Shannon informational entropy. In this work we investigate the CE for the case of the AdS/QCD hard wall model at finite temperature. We propose a regularized form for the energy densities of the black hole (BH) and of the thermal AdS geometries that makes it possible to calculate their CEs as a function of the temperature. We find a relation between stability and the value of the CE for the system of asymptotically AdS geometries. Remarkably, it is found that the CE is proportional to $\log(T)$, where $T$ is the temperature. This result makes it possible to write out a simple relation between the configuration and the thermodynamic entropies.


title: Iwasawa theory of automorphic representations of $\mathrm{GL}_{2n}$ at non-ordinary primes

abstract: Let $\Pi$ be a cuspidal automorphic representation of $\mathrm{GL}_{2n}(\mathbb{A_Q})$ and let $p$ be an odd prime at which $\Pi$ is unramified. In a recent work, Barrera, Dimitrov and Williams constructed possibly unbounded $p$-adic $L$-functions interpolating complex $L$-values of $\Pi$ in the non-ordinary case. Under certain assumptions, we construct two \textit{bounded} $p$-adic $L$-functions for $\Pi$, thus extending an earlier work of Rockwood by relaxing the Pollack condition. Using Langlands local-global compatibility, we define signed Selmer groups over the $p$-adic cyclotomic extension of $\mathbb{Q}$ attached to the $p$-adic Galois representation of $\Pi$ and formulate Iwasawa main conjectures in the spirit of Kobayashi's plus and minus main conjectures for $p$-supersingular elliptic curves.


title: Binary Neural Networks for Memory-Efficient and Effective Visual Place Recognition in Changing Environments

abstract: Visual place recognition (VPR) is a robot's ability to determine whether a place was visited before using visual data. While conventional hand-crafted methods for VPR fail under extreme environmental appearance changes, those based on convolutional neural networks (CNNs) achieve state-of-the-art performance but result in heavy runtime processes and model sizes that demand a large amount of memory. Hence, CNN-based approaches are unsuitable for resource-constrained platforms, such as small robots and drones. In this paper, we take a multi-step approach of decreasing the precision of model parameters, combining it with network depth reduction and fewer neurons in the classifier stage to propose a new class of highly compact models that drastically reduces the memory requirements and computational effort while maintaining state-of-the-art VPR performance. To the best of our knowledge, this is the first attempt to propose binary neural networks for solving the visual place recognition problem effectively under changing conditions and with significantly reduced resource requirements. Our best-performing binary neural network, dubbed FloppyNet, achieves comparable VPR performance when considered against its full-precision and deeper counterparts while consuming 99% less memory and increasing the inference speed seven times.


title: Deep Reinforcement Learning with Mixed Convolutional Network

abstract: Recent research has shown that map raw pixels from a single front-facing camera directly to steering commands are surprisingly powerful. This paper presents a convolutional neural network (CNN) to playing the CarRacing-v0 using imitation learning in OpenAI Gym. The dataset is generated by playing the game manually in Gym and used a data augmentation method to expand the dataset to 4 times larger than before. Also, we read the true speed, four ABS sensors, steering wheel position, and gyroscope for each image and designed a mixed model by combining the sensor input and image input. After training, this model can automatically detect the boundaries of road features and drive the robot like a human. By comparing with AlexNet and VGG16 using the average reward in CarRacing-v0, our model wins the maximum overall system performance.


title: When to Impute? Imputation before and during cross-validation

abstract: Cross-validation (CV) is a technique used to estimate generalization error for prediction models. For pipeline modeling algorithms (i.e. modeling procedures with multiple steps), it has been recommended the entire sequence of steps be carried out during each replicate of CV to mimic the application of the entire pipeline to an external testing set. While theoretically sound, following this recommendation can lead to high computational costs when a pipeline modeling algorithm includes computationally expensive operations, e.g. imputation of missing values. There is a general belief that unsupervised variable selection (i.e. ignoring the outcome) can be applied before conducting CV without incurring bias, but there is less consensus for unsupervised imputation of missing values. We empirically assessed whether conducting unsupervised imputation prior to CV would result in biased estimates of generalization error or result in poorly selected tuning parameters and thus degrade the external performance of downstream models. Results show that despite optimistic bias, the reduced variance of imputation before CV compared to imputation during each replicate of CV leads to a lower overall root mean squared error for estimation of the true external R-squared and the performance of models tuned using CV with imputation before versus during each replication is minimally different. In conclusion, unsupervised imputation before CV appears valid in certain settings and may be a helpful strategy that enables analysts to use more flexible imputation techniques without incurring high computational costs.


title: Inferring physical properties of stellar collapse by third-generation gravitational-wave detectors

abstract: Galactic core-collapse supernovae are among the possible sources of gravitational waves. We investigate the ability of gravitational-wave observatories to extract the properties of the collapsing progenitor from the gravitational waves radiated. We use simulations of supernovae that explore a variety of progenitor core rotation rates and nuclear equations of state and examine the ability of current and future observatories to determine these properties using gravitational-wave parameter estimation. We use principal component analysis of the simulation catalog to determine the dominant features of the waveforms and create a map between the measured properties of the waveform and the physical properties of the progenitor. We use Bayesian parameter inference and the parameter map to calculate posterior probabilities for the physical properties given a gravitational-wave observation. We estimate the ratio of the progenitor's core rotational kinetic energy to potential energy ($\beta$) and the post bounce oscillation frequency. For a supernovae at the distance of the galactic center (8.1 kpc) with $\beta = 0.02$ our method can estimate $\beta$ with a $90\%$ credible interval of $0.004$ for Advanced LIGO, improving to $0.0008$ for Cosmic Explorer. We demonstrate that if the core is rotating sufficiently rapidly for a signal observed by Cosmic Explorer, our method can also extract the post bounce oscillation frequency of the protoneutron star to a precision of within $5$~Hz ($90\%$ credible interval) allowing us to constrain the nuclear equation of state. For a supernovae at the distance of the Magellanic Clouds (48.5 kpc) Cosmic Explorer's ability to measure these parameters decreases slightly to $0.003$ for rotation and $11$~Hz for the postbounce oscillation frequency ($90\%$ credible interval). Sources in Magellanic Clouds will be too distant for Advanced LIGO to measure these properties.


title: CAFT: Congestion-Aware Fault-Tolerant Load Balancing for Three-Tier Clos Data Centers

abstract: Production data centers operate under various workload sizes ranging from latency-sensitive mice flows to long-lived elephant flows. However, the predominant load balancing scheme in data center networks, equal-cost multi-path (ECMP), is agnostic to path conditions and performs poorly in asymmetric topologies, resulting in low throughput and high latencies. In this paper, we propose CAFT, a distributed congestion-aware fault-tolerant load balancing protocol for 3-tier data center networks. It first collects, in real time, the complete congestion information of two subsets from the set of all possible paths between any two hosts. Then, the best path congestion information from each subset is carried across the switches, during the Transport Control Protocol (TCP) connection process, to make path selection decision. Having two candidate paths improve the robustness of CAFT to asymmetries caused by link failures. Large-scale ns-3 simulations show that CAFT outperforms Expeditus in mean flow completion time (FCT) and network throughput for both symmetric and asymmetric scenarios.


title: Using Unlabeled Data for Increasing Low-Shot Classification Accuracy of Relevant and Open-Set Irrelevant Images

abstract: In search, exploration, and reconnaissance tasks performed with autonomous ground vehicles, an image classification capability is needed for specifically identifying targeted objects (relevant classes) and at the same time recognize when a candidate image does not belong to anyone of the relevant classes (irrelevant images). In this paper, we present an open-set low-shot classifier that uses, during its training, a modest number (less than 40) of labeled images for each relevant class, and unlabeled irrelevant images that are randomly selected at each epoch of the training process. The new classifier is capable of identifying images from the relevant classes, determining when a candidate image is irrelevant, and it can further recognize categories of irrelevant images that were not included in the training (unseen). The proposed low-shot classifier can be attached as a top layer to any pre-trained feature extractor when constructing a Convolutional Neural Network.


title: Evaluating a Generative Adversarial Framework for Information Retrieval

abstract: Recent advances in Generative Adversarial Networks (GANs) have resulted in its widespread applications to multiple domains. A recent model, IRGAN, applies this framework to Information Retrieval (IR) and has gained significant attention over the last few years. In this focused work, we critically analyze multiple components of IRGAN, while providing experimental and theoretical evidence of some of its shortcomings. Specifically, we identify issues with the constant baseline term in the policy gradients optimization and show that the generator harms IRGAN's performance. Motivated by our findings, we propose two models influenced by self-contrastive estimation and co-training which outperform IRGAN on two out of the three tasks considered.


title: Continuous limits of generalized pentagram maps

abstract: We provide a rigorous treatment of continuous limits for various generalizations of the pentagram map on polygons in $\mathbb{RP}^d$ by means of quantum calculus. Describing this limit in detail for the case of the short-diagonal pentagram map, we verify that this construction yields the $(2,d+1)$-KdV equation, and moreover, the Lax form of the pentagram map in the limit is proved to become the Lax representation of the corresponding KdV system. More generally, we introduce the $\chi$-pentagram map, a geometric construction defining curve evolutions by directly taking intersections of subspaces through specified points. We show that its different configurations yield certain other KdV equations and provide an argument towards disproving the conjecture that any KdV-type equation can be discretized through pentagram-type maps.


title: Fast fully-reproducible serial/parallel Monte Carlo and MCMC simulations and visualizations via ParaMonte::Python library

abstract: ParaMonte::Python (standing for Parallel Monte Carlo in Python) is a serial and MPI-parallelized library of (Markov Chain) Monte Carlo (MCMC) routines for sampling mathematical objective functions, in particular, the posterior distributions of parameters in Bayesian modeling and analysis in data science, Machine Learning, and scientific inference in general. In addition to providing access to fast high-performance serial/parallel Monte Carlo and MCMC sampling routines, the ParaMonte::Python library provides extensive post-processing and visualization tools that aim to automate and streamline the process of model calibration and uncertainty quantification in Bayesian data analysis. Furthermore, the automatically-enabled restart functionality of ParaMonte::Python samplers ensure seamless fully-deterministic into-the-future restart of Monte Carlo simulations, should any interruptions happen. The ParaMonte::Python library is MIT-licensed and is permanently maintained on GitHub at https://github.com/cdslaborg/paramonte/tree/master/src/interface/Python.


title: Reducibility of self-adjoint linear relations and application to generalized Nevanlinna functions

abstract: Necessary and sufficient conditions for reducidibility of a self-adjoint linear relation in a Krein space are given. Then a generalized Nevanlinna function $Q$, represented by a self-adjoint linear relation $A$, is decomposed by means of the reducing subspaces of $A$. The sum of two functions $Q_{i}{\in N}_{\kappa_{i}}\left( \mathcal{H} \right),\thinspace i=1,\thinspace 2$, minimally represented by the triplets $\left( \mathcal{K}_{i},A_{i},\Gamma_{i} \right)$, is also studied. For that purpose, a model $( \tilde{\mathcal{K}},\tilde{A},\tilde{\Gamma } )$ to represent $Q:=Q_{1}+Q_{2}$ in terms of $\left( \mathcal{K}_{i},A_{i},\Gamma_{i} \right)$ is created. By means of that model, necessary and sufficient conditions for $\kappa =\kappa_{1}+\kappa_{2}$ are proven in analytic terms. At the end, it is explained how degenerate Jordan chains of the representing relation $A$ affect reducing subspaces of $A$ and decomposition of the corresponding function $Q$.


title: Hypergraph regularity and higher arity VC-dimension

abstract: We generalize the fact that graphs with small VC-dimension can be approximated by rectangles, showing that hypergraphs with small VC_k-dimension (equivalently, omitting a fixed finite (k+1)-partite (k+1)-uniform hypergraph) can be approximated by k-ary cylinder sets. In the language of hypergraph regularity, this shows that when H is a k'-uniform hypergraph with small VC_k-dimension for some k<k', the decomposition of H given by hypergraph regularity only needs the first k levels---one can approximate H using sets of vertices, sets of pairs, and so on up to sets of k-tuples---and that on most of the resulting k-ary cylinder sets, the density of H is either close to 0 or close to 1. We also show a suitable converse: k'-uniform hypergraphs with large VC_k-dimension cannot have such approximations uniformly under all measures on the vertices.


title: Parameter Estimation via Fokker-Planck Type Residual: Application to Linear Stationary Random Vibration

abstract: In this study, we propose a new method that is useful for estimating unknown parameter values of stochastic differential equation (SDE) models, based on probability density function (PDF) data measured from random dynamical systems. As our method does not require explicit description of PDF, it can be applied to the SDE models even when their PDFs are hardly derived in explicit forms due to multiplicative-noise terms, nonlinear terms, and so on. Therefore, our method is expected to provide a versatile tool to dynamically parameterize measured PDF data. In our proposed method, it is assumed that a measured PDF is obtained from a random dynamical system whose structure is described by a known SDE model with unknown parameter values. With the help of It\^o calculus, the Fokker-Planck equation (FPE) is derived from the SDE model. The measured PDF and a candidate of parameter values are substituted into the FPE to calculate a FPE residual. Our method is applied to two random vibration systems. Their FPE residuals tend to zero as the parameter values tend to exact values, showing that our proposed FPE residual can be utilized for unknown parameter estimation of SDE models.


title: Revisiting Runtime Dynamic Optimization for Join Queries in Big Data Management Systems

abstract: Query Optimization remains an open problem for Big Data Management Systems. Traditional optimizers are cost-based and use statistical estimates of intermediate result cardinalities to assign costs and pick the best plan. However, such estimates tend to become less accurate because of filtering conditions caused either from undetected correlations between multiple predicates local to a single dataset, predicates with query parameters, or predicates involving user-defined functions (UDFs). Consequently, traditional query optimizers tend to ignore or miscalculate those settings, thus leading to suboptimal execution plans. Given the volume of today's data, a suboptimal plan can quickly become very inefficient. In this work, we revisit the old idea of runtime dynamic optimization and adapt it to a shared-nothing distributed database system, AsterixDB. The optimization runs in stages (re-optimization points), starting by first executing all predicates local to a single dataset. The intermediate result created from each stage is used to re-optimize the remaining query. This re-optimization approach avoids inaccurate intermediate result cardinality estimations, thus leading to much better execution plans. While it introduces the overhead for materializing these intermediate results, our experiments show that this overhead is relatively small and it is an acceptable price to pay given the optimization benefits. In fact, our experimental evaluation shows that runtime dynamic optimization leads to much better execution plans as compared to the current default AsterixDB plans as well as to plans produced by static cost-based optimization (i.e. based on the initial dataset statistics) and other state-of-the-art approaches.


title: Individual-centered partial information in social networks

abstract: In statistical network analysis, we often assume either the full network is available or multiple subgraphs can be sampled to estimate various global properties of the network. However, in a real social network, people frequently make decisions based on their local view of the network alone. Here, we consider a partial information framework that characterizes the local network centered at a given individual by path length $L$ and gives rise to a partial adjacency matrix. Under $L=2$, we focus on the problem of (global) community detection using the popular stochastic block model (SBM) and its degree-corrected variant (DCSBM). We derive general properties of the eigenvalues and eigenvectors from the signal term of the partial adjacency matrix and propose new spectral-based community detection algorithms that achieve consistency under appropriate conditions. Our analysis also allows us to propose a new centrality measure that assesses the importance of an individual's partial information in determining global community structure. Using simulated and real networks, we demonstrate the performance of our algorithms and compare our centrality measure with other popular alternatives to show it captures unique nodal information. Our results illustrate that the partial information framework enables us to compare the viewpoints of different individuals regarding the global structure.


title: Modifying the Symbolic Aggregate Approximation Method to Capture Segment Trend Information

abstract: The Symbolic Aggregate approXimation (SAX) is a very popular symbolic dimensionality reduction technique of time series data, as it has several advantages over other dimensionality reduction techniques. One of its major advantages is its efficiency, as it uses precomputed distances. The other main advantage is that in SAX the distance measure defined on the reduced space lower bounds the distance measure defined on the original space. This enables SAX to return exact results in query-by-content tasks. Yet SAX has an inherent drawback, which is its inability to capture segment trend information. Several researchers have attempted to enhance SAX by proposing modifications to include trend information. However, this comes at the expense of giving up on one or more of the advantages of SAX. In this paper we investigate three modifications of SAX to add trend capturing ability to it. These modifications retain the same features of SAX in terms of simplicity, efficiency, as well as the exact results it returns. They are simple procedures based on a different segmentation of the time series than that used in classic-SAX. We test the performance of these three modifications on 45 time series datasets of different sizes, dimensions, and nature, on a classification task and we compare it to that of classic-SAX. The results we obtained show that one of these modifications manages to outperform classic-SAX and that another one slightly gives better results than classic-SAX.


title: LiRaNet: End-to-End Trajectory Prediction using Spatio-Temporal Radar Fusion

abstract: In this paper, we present LiRaNet, a novel end-to-end trajectory prediction method which utilizes radar sensor information along with widely used lidar and high definition (HD) maps. Automotive radar provides rich, complementary information, allowing for longer range vehicle detection as well as instantaneous radial velocity measurements. However, there are factors that make the fusion of lidar and radar information challenging, such as the relatively low angular resolution of radar measurements, their sparsity and the lack of exact time synchronization with lidar. To overcome these challenges, we propose an efficient spatio-temporal radar feature extraction scheme which achieves state-of-the-art performance on multiple large-scale datasets.Further, by incorporating radar information, we show a 52% reduction in prediction error for objects with high acceleration and a 16% reduction in prediction error for objects at longer range.


title: Extreme-SAX: Extreme Points Based Symbolic Representation for Time Series Classification

abstract: Time series classification is an important problem in data mining with several applications in different domains. Because time series data are usually high dimensional, dimensionality reduction techniques have been proposed as an efficient approach to lower their dimensionality. One of the most popular dimensionality reduction techniques of time series data is the Symbolic Aggregate Approximation (SAX), which is inspired by algorithms from text mining and bioinformatics. SAX is simple and efficient because it uses precomputed distances. The disadvantage of SAX is its inability to accurately represent important points in the time series. In this paper we present Extreme-SAX (E-SAX), which uses only the extreme points of each segment to represent the time series. E-SAX has exactly the same simplicity and efficiency of the original SAX, yet it gives better results in time series classification than the original SAX, as we show in extensive experiments on a variety of time series datasets.


title: Exploiting Multi-Path for Safeguarding mmWave Communications Against Randomly Located Eavesdroppers

abstract: Communication in the millimeter-wave (mmWave) band has recently been proposed to enable giga-bit-per-second data rates for next generation wireless systems. Physical layer security techniques have emerged as a simple and yet effective way to safeguard these systems against eavesdropping attacks. These techniques make use of the large antenna arrays available in mmWave systems to provide an array gain at the target receiver and degrade the signal quality at the eavesdropper. Despite their effectiveness, majority of these techniques are based on line-of-sight communication links between the transmitter and the receiver, and may fail in the presence of blockages or non-line-of-sight links. This paper builds upon previous work and extends physical layer security to the non-line-of-sight communication case and randomly located eavesdroppers. Specifically, the large dimensional antenna arrays in mmWave systems and the intrinsic characteristics of wireless channel are exploited to induce noiselike signals that jam eavesdroppers with sensitive receivers. Numerical results show that the proposed techniques provide higher secrecy rate when compared to conventional array and physical layer techniques based on line-of-sight links.


title: Training Strategies to Handle Missing Modalities for Audio-Visual Expression Recognition

abstract: Automatic audio-visual expression recognition can play an important role in communication services such as tele-health, VOIP calls and human-machine interaction. Accuracy of audio-visual expression recognition could benefit from the interplay between the two modalities. However, most audio-visual expression recognition systems, trained in ideal conditions, fail to generalize in real world scenarios where either the audio or visual modality could be missing due to a number of reasons such as limited bandwidth, interactors' orientation, caller initiated muting. This paper studies the performance of a state-of-the art transformer when one of the modalities is missing. We conduct ablation studies to evaluate the model in the absence of either modality. Further, we propose a strategy to randomly ablate visual inputs during training at the clip or frame level to mimic real world scenarios. Results conducted on in-the-wild data, indicate significant generalization in proposed models trained on missing cues, with gains up to 17% for frame level ablations, showing that these training strategies cope better with the loss of input modalities.


title: Cycle-Consistent Adversarial Autoencoders for Unsupervised Text Style Transfer

abstract: Unsupervised text style transfer is full of challenges due to the lack of parallel data and difficulties in content preservation. In this paper, we propose a novel neural approach to unsupervised text style transfer, which we refer to as Cycle-consistent Adversarial autoEncoders (CAE) trained from non-parallel data. CAE consists of three essential components: (1) LSTM autoencoders that encode a text in one style into its latent representation and decode an encoded representation into its original text or a transferred representation into a style-transferred text, (2) adversarial style transfer networks that use an adversarially trained generator to transform a latent representation in one style into a representation in another style, and (3) a cycle-consistent constraint that enhances the capacity of the adversarial style transfer networks in content preservation. The entire CAE with these three components can be trained end-to-end. Extensive experiments and in-depth analyses on two widely-used public datasets consistently validate the effectiveness of proposed CAE in both style transfer and content preservation against several strong baselines in terms of four automatic evaluation metrics and human evaluation.


title: Data-driven model reduction for stochastic Burgers equations

abstract: We present a class of efficient parametric closure models for 1D stochastic Burgers equations. Casting it as statistical learning of the flow map, we derive the parametric form by representing the unresolved high wavenumber Fourier modes as functionals of the resolved variables' trajectory. The reduced models are nonlinear autoregression (NAR) time series models, with coefficients estimated from data by least squares. The NAR models can accurately reproduce the energy spectrum, the invariant densities, and the autocorrelations. Taking advantage of the simplicity of the NAR models, we investigate maximal and optimal space-time reduction. Reduction in space dimension is unlimited, and NAR models with two Fourier modes can perform well. The NAR model's stability limits time reduction, with a maximal time step smaller than that of the K-mode Galerkin system. We report a potential criterion for optimal space-time reduction: the NAR models achieve minimal relative error in the energy spectrum at the time step where the K-mode Galerkin system's mean CFL number agrees with the full model's.


title: Well-posedness and asymptotics of a coordinate-free model of flame fronts

abstract: We investigate a coordinate-free model of flame fronts introduced by Frankel and Sivashinsky; this model has a parameter $\alpha$ which relates to how unstable the front might be. We first prove short-time well-posedness of the coordinate-free model, for any value of $\alpha>0.$ We then argue that near the threshold $\alpha \approx 1,$ the solution stays arbitrarily close to the solution of the weakly nonlinear Kuramoto--Sivashinsky (KS) equation, as long as the initial values are close.


title: Large Latin American Millimeter Array

abstract: The Large Latin American Millimeter Array (LLAMA) is a multipurpose single-dish 12 m radiotelescope with VLBI capability under construction in the Puna de Atacama desert in the Province of Salta, Argentina. In this paper I review the project, the instrument, the current status, and the scientific goals of this astronomical collaboration between Argentina and Brazil.


title: Energy-flux vector in anisotropic turbulence: application to rotating turbulence

abstract: Energy flux plays a key role in the analyses of energy-cascading turbulence. In isotropic turbulence, the flux is given by a scalar as a function of the magnitude of the wavenumber. On the other hand, the flux in anisotropic turbulence should be a geometric vector that has a direction as well as the magnitude, and depends not only on the magnitude of the wavenumber but also on its direction. The energy-flux vector in the anisotropic turbulence cannot be uniquely determined in a way used for the isotropic flux. In this work, introducing two ansatzes, net locality and efficiency of the nonlinear energy transfer, we propose a way to determine the energy-flux vector in anisotropic turbulence by using the Moore--Penrose inverse. The energy-flux vector in strongly rotating turbulence is demonstrated based on the energy transfer rate obtained by direct numerical simulations. It is found that the direction of the energy-flux vector is consistent with the prediction of the weak turbulence theory in the wavenumber range dominated by the inertial waves. However, the energy flux along the critical wavenumbers predicted by the critical balance in the buffer range between in the weak turbulence range and the isotropic Kolmogorov turbulence range is not observed in the present simulations. This discrepancy between the critical balance and the present numerical results is discussed and the dissipation is found to play an important role in the energy flux in the buffer range.


title: HIV transmission in men who have sex with men in England: on track for elimination by 2030?

abstract: Background: After a decade of a treatment as prevention (TasP) strategy based on progressive HIV testing scale-up and earlier treatment, a reduction in the estimated number of new infections in men-who-have-sex-with-men (MSM) in England had yet to be identified by 2010. To achieve internationally agreed targets for HIV control and elimination, test-and-treat prevention efforts have been dramatically intensified over the period 2010-2015, and, from 2016, further strengthened by pre-exposure prophylaxis (PrEP). Methods: Application of a novel age-stratified back-calculation approach to data on new HIV diagnoses and CD4 count-at-diagnosis, enabled age-specific estimation of HIV incidence, undiagnosed infections and mean time-to-diagnosis across both the 2010-2015 and 2016-2018 periods. Estimated incidence trends were then extrapolated, to quantify the likelihood of achieving HIV elimination by 2030. Findings: A fall in HIV incidence in MSM is estimated to have started in 2012/3, eighteen months before the observed fall in new diagnoses. A steep decrease from 2,770 annual infections (95% credible interval 2.490-3,040) in 2013 to 1,740 (1,500-2,010) in 2015 is estimated, followed by steady decline from 2016, reaching 854 (441-1,540) infections in 2018. A decline is consistently estimated in all age groups, with a fall particularly marked in the 24-35 age group, and slowest in the 45+ group. Comparable declines are estimated in the number of undiagnosed infections. Interpretation: The peak and subsequent sharp decline in HIV incidence occurred prior to the phase-in of PrEP. Definining elimination as a public health threat to be < 50 new infections (1.1 infections per 10,000 at risk), 40% of incidence projections hit this threshold by 2030. In practice, targeted policies will be required, particularly among the 45+y where STIs are increasing most rapidly.


title: Smart-Inspect: Micro Scale Localization and Classification of Smartphone Glass Defects for Industrial Automation

abstract: The presence of any type of defect on the glass screen of smart devices has a great impact on their quality. We present a robust semi-supervised learning framework for intelligent micro-scaled localization and classification of defects on a 16K pixel image of smartphone glass. Our model features the efficient recognition and labeling of three types of defects: scratches, light leakage due to cracks, and pits. Our method also differentiates between the defects and light reflections due to dust particles and sensor regions, which are classified as non-defect areas. We use a partially labeled dataset to achieve high robustness and excellent classification of defect and non-defect areas as compared to principal components analysis (PCA), multi-resolution and information-fusion-based algorithms. In addition, we incorporated two classifiers at different stages of our inspection framework for labeling and refining the unlabeled defects. We successfully enhanced the inspection depth-limit up to 5 microns. The experimental results show that our method outperforms manual inspection in testing the quality of glass screen samples by identifying defects on samples that have been marked as good by human inspection.


title: The relative frequency between two continuous-state branching processes with immigration and their genealogy

abstract: When two (possibly different in distribution) continuous-state branching processes with immigration are present, we study the relative frequency of one of them when the total mass is forced to be constant at a dense set of times. This leads to a SDE whose unique strong solution will be the definition of a $\Lambda$-asymmetric frequency process ($\Lambda$-AFP). We prove that it is a Feller process and we calculate a large population limit when the total mass tends to infinity. This allows us to study the fluctuations of the process around its deterministic limit. Furthermore, we find conditions for the $\Lambda$-AFP to have a moment dual. The dual can be interpreted in terms of selection, (coordinated) mutation, pairwise branching (efficiency), coalescence, and a novel component that comes from the asymmetry between the reproduction mechanisms. In the particular case of a pair of equally distributed continuous-state branching processes, the associated $\Lambda$-AFP will be the dual of a $\Lambda$-coalescent. The map that sends each continuous-state branching process to its associated $\Lambda$-coalescent (according to the former procedure) is a homeomorphism between metric spaces.


title: Cell Complex Neural Networks

abstract: Cell complexes are topological spaces constructed from simple blocks called cells. They generalize graphs, simplicial complexes, and polyhedral complexes that form important domains for practical applications. They also provide a combinatorial formalism that allows the inclusion of complicated relationships of restrictive structures such as graphs and meshes. In this paper, we propose \textbf{Cell Complexes Neural Networks (CXNs)}, a general, combinatorial and unifying construction for performing neural network-type computations on cell complexes. We introduce an inter-cellular message passing scheme on cell complexes that takes the topology of the underlying space into account and generalizes message passing scheme to graphs. Finally, we introduce a unified cell complex encoder-decoder framework that enables learning representation of cells for a given complex inside the Euclidean spaces. In particular, we show how our cell complex autoencoder construction can give, in the special case \textbf{cell2vec}, a generalization for node2vec.


title: Oxygen depletion in FLASH ultra-high-dose-rate radiotherapy: A molecular dynamics simulation

abstract: We present a first-principles molecular dynamics (MD) simulation and expound upon a mechanism of oxygen depletion hypothesis to explain the mitigation of normal tissue injury observed in ultra-high-dose-rate (UHDR) FLASH radiotherapy. We simulated damage to a segment of DNA (also representing other bio-molecules such as RNA and proteins) in a simulation box filled with H$_2$O and O$_2$ molecules. Attoseconds physical interactions (ionizations, electronic and vibrational excitations) were simulated by using the Monte Carlo track structure code Geant4-DNA. Immediately after ionization, {\it ab initio} Car-Parrinello molecular dynamics (CPMD) simulation was used to identify which H$_2$O and O$_2$ molecules surrounding the DNA-molecule were converted into reactive oxygen species (ROS). Subsequently, the femto- to nano-second reactions of ROS were simulated by using MD with Reactive Force Field (ReaxFF), to illustrate ROS merging into new types of non-reactive oxygen species (NROS) due to strong coupling among ROS. Time-dependent molecular simulations revealed the formation of metastable and transient spaghetti-like complexes among ROS generated at UHDR. At the higher ROS densities produced under UHDR, stranded chains (i.e., NROS) are produced, mediated through attractive electric polarity forces, hydrogen bonds, and magnetic dipole-dipole interactions among hydroxyl (\ce{^{.}OH}) radicals. NROS tend to be less mobile than cellular biomolecules as opposed to the isolated and sparsely dense ROS generated at conventional dose rates (CDR). We attribute this effect to the suppression of bio-molecular damage induced per particle track. At a given oxygen level, as the dose rate increases, the size and number of NROS chains increase, and correspondingly the population of toxic ROS components decreases.

categories: physics.med-ph cond-mat.mes-hall physics.bio-ph physics.chem-ph physics.comp-ph


title: Keep your Communities Clean: Exploring the Routing Message Impact of BGP Communities

abstract: BGP communities are widely used to tag prefix aggregates for policy, traffic engineering, and inter-AS signaling. Because individual ASes define their own community semantics, many ASes blindly propagate communities they do not recognize. Prior research has shown the potential security vulnerabilities when communities are not filtered. This work sheds light on a second unintended side-effect of communities and permissive propagation: an increase in unnecessary BGP routing messages. Due to its transitive property, a change in the community attribute induces update messages throughout established routes, just updating communities. We ground our work by characterizing the handling of updates with communities, including when filtered, on multiple real-world BGP implementations in controlled laboratory experiments. We then examine 10 years of BGP messages observed in the wild at two route collector systems. In 2020, approximately 25% of all announcements modify the community attribute, but retain the AS path of the most recent announcement; an additional 25% update neither community nor AS path. Using predictable beacon prefixes, we demonstrate that communities lead to an increase in update messages both at the tagging AS and at neighboring ASes that neither add nor filter communities. This effect is prominent for geolocation communities during path exploration: on a single day, 63% of all unique community attributes are revealed exclusively due to global withdrawals.


title: Grothendieck's inequality and completely correlation preserving functions -- a summary of recent results and an indication of related research problems

abstract: As part of the search for the value of the smallest upper bound of the best constant for the famous Grothendieck inequality, the so-called Grothendieck constant (a hard open problem - unsolved since 1953), we provide a further approach, primarily built on functions which map correlation matrices entrywise to correlation matrices by means of the Schur product, multivariate Gaussian analysis, copulas and inversion of suitable Taylor series. We summarise first results and point towards related open problems and topics for future research.


title: Contrastive Learning of Medical Visual Representations from Paired Images and Text

abstract: Learning visual representations of medical images (e.g., X-rays) is core to medical image understanding but its progress has been held back by the scarcity of human annotations. Existing work commonly relies on fine-tuning weights transferred from ImageNet pretraining, which is suboptimal due to drastically different image characteristics, or rule-based label extraction from the textual report data paired with medical images, which is inaccurate and hard to generalize. Meanwhile, several recent studies show exciting results from unsupervised contrastive learning from natural images, but we find these methods help little on medical images because of their high inter-class similarity. We propose ConVIRT, an alternative unsupervised strategy to learn medical visual representations by exploiting naturally occurring paired descriptive text. Our new method of pretraining medical image encoders with the paired text data via a bidirectional contrastive objective between the two modalities is domain-agnostic, and requires no additional expert input. We test ConVIRT by transferring our pretrained weights to 4 medical image classification tasks and 2 zero-shot retrieval tasks, and show that it leads to image representations that considerably outperform strong baselines in most settings. Notably, in all 4 classification tasks, our method requires only 10\% as much labeled training data as an ImageNet initialized counterpart to achieve better or comparable performance, demonstrating superior data efficiency.


title: Piecewise-analytic interfaces with weakly singular points of arbitrary order always scatter

abstract: It is proved that an inhomogeneous medium whose boundary contains a weakly singular point of arbitrary order scatters every incoming wave. Similarly, a compactly supported source term with weakly singular points on the boundary always radiates acoustic waves. These results imply the absence of non-scattering energies and non-radiating sources in a domain that is not $C^\infty$-smooth. Local uniqueness results with a single far-field pattern are obtained for inverse source and inverse medium scattering problems. Our arguments provide a sufficient condition of the surface under which solutions to the Helmholtz equation admits no analytical continuation.


title: Dynamic Phase Diagram of an Orthogonal Spin Torque device: Topological Category

abstract: The magnetization evolution of the free layer in an orthogonal spin-torque device is studied based on a macrospin model. The trajectory of magnetization vector under various conditions has shown rich nonlinear properties. The phase diagram is obtained in the parameter spaces of current density and the polarization distribution (the ratio of in-plane and out-of-plane polarizers). These dynamic phases can be classified according to their nonlinear behaviors which are topologically different, namely limit point and/or limit cycle. The topological classification is meaningful to design the ultra-fast spin-torque devices under different dynamic conditions towards various applications such as memory and oscillators.


title: A topological invariant for continuous fields of Cuntz algebras II

abstract: We investigate an invariant for continuous fields of the Cuntz algebra $\mathcal{O}_{n+1}$ introduced in our previous work, and find a way to obtain a continuous field of $\mathbb{M}_n(\mathcal{O}_\infty)$ from that of $\mathcal{O}_{n+1}$ using the construction of the invariant. By Brown's representability theorem, this gives a bijection from the set of the isomorphism classes of continuous fields of $\mathcal{O}_{n+1}$ to those of $\mathbb{M}_n(\mathcal{O}_\infty)$. As a consequence, we obtain a new proof for M. Dadarlat's classification result of continuous fields of $\mathcal{O}_{n+1}$ arising from vector bundles, which corresponds to those of $\mathbb{M}_n(\mathcal{O}_\infty)$ stably isomorphic to the trivial field.


title: Direct Generation of Radially Polarized Vector Vortex Beam with an Exciton-Polariton Laser

abstract: Vector vortex beams are a class of optical beams with singularities in their space-variant polarization. Vector vortex beam lasers have applications in many areas including imaging and communication, where vertical-cavity lasers emitting Gaussian beams have been most widely used so far. Generation of vector vortex beams from vertical-cavity lasers has required external control or modulation. Here, by utilizing a polarization-selective subwavelength grating as one of the reflectors in a vertical semiconductor microcavity, we design the spin textures of the polariton mode and demonstrate polariton lasing in a single-mode, radially polarized vector vortex beam. Polarization and phase distributions of the emission are characterized by polarization-resolved imaging and interferometry. This method of vector vortex laser beam generation allows low threshold power, stable single-mode operation, scalability, and on-chip integration, all of which are important for applications in imaging and communication.


title: Specifying User Preferences using Weighted Signal Temporal Logic

abstract: We extend Signal Temporal Logic (STL) to enable the specification of importance and priorities. The extension, called Weighted STL (wSTL), has the same qualitative (Boolean) semantics as STL, but additionally defines weights associated with Boolean and temporal operators that modulate its quantitative semantics (robustness). We show that the robustness of wSTL can be defined as weighted generalizations of all known compatible robustness functionals (i.e., robustness scores that are recursively defined over formulae) that can take into account the weights in wSTL formulae. We utilize this weighted robustness to distinguish signals with respect to a desired wSTL formula that has sub-formulae with different importance or priorities and time preferences, and demonstrate its usefulness in problems with conflicting tasks where satisfaction of all tasks cannot be achieved. We also employ wSTL robustness in an optimization framework to synthesize controllers that maximize satisfaction of a specification with user specified preferences.


title: Model-sharing Games: Analyzing Federated Learning Under Voluntary Participation

abstract: Federated learning is a setting where agents, each with access to their own data source, combine models from local data to create a global model. If agents are drawing their data from different distributions, though, federated learning might produce a biased global model that is not optimal for each agent. This means that agents face a fundamental question: should they choose the global model or their local model? We show how this situation can be naturally analyzed through the framework of coalitional game theory. We propose the following game: there are heterogeneous players with different model parameters governing their data distribution and different amounts of data they have noisily drawn from their own distribution. Each player's goal is to obtain a model with minimal expected mean squared error (MSE) on their own distribution. They have a choice of fitting a model based solely on their own data, or combining their learned parameters with those of some subset of the other players. Combining models reduces the variance component of their error through access to more data, but increases the bias because of the heterogeneity of distributions. Here, we derive exact expected MSE values for problems in linear regression and mean estimation. We then analyze the resulting game in the framework of hedonic game theory; we study how players might divide into coalitions, where each set of players within a coalition jointly construct model(s). We analyze three methods of federation, modeling differing degrees of customization. In uniform federation, the agents collectively produce a single model. In coarse-grained federation, each agent can weight the global model together with their local model. In fine-grained federation, each agent can flexibly combine models from all other agents in the federation. For each method, we analyze the stable partitions of players into coalitions.


title: P = FS: Parallel is Just Fast Serial

abstract: We prove that parallel processing with homogeneous processors is logically equivalent to fast serial processing. The reverse proposition can also be used to identify obscure opportunities for applying parallelism. To our knowledge, this theorem has not been previously reported in the queueing theory literature. A plausible explanation is offered for why this might be. The basic homogeneous theorem is also extended to optimizing the latency of heterogenous parallel arrays.


title: Degree spectra of analytic complete equivalence relations

abstract: We study the bi-embeddability and elementary bi-embeddability relation on graphs under Borel reducibility and investigate the degree spectra realized by this relations. We first give a Borel reduction from embeddability on graphs to elementary embeddability on graphs. As a consequence we obtain that elementary bi-embeddability on graphs is a analytic complete equivalence relation. We then investigate the algorithmic properties of this reduction to show that every bi-embeddability spectrum of a graph is the jump spectrum of an elementary bi-embeddability spectrum of a graph.


title: The effect of cooling on the accretion of circumprimary discs inmerging supermassive black hole binaries

abstract: At the final stages of a supermassive black hole coalescence, the emission of gravitational waves will efficiently remove energy and angular momentum from the binary orbit, allowing the separation between the compact objects to shrink. In the scenario where a circumprimary disc is present, a squeezing phase will develop, in which the tidal interaction between the disc and the secondary black hole could push the gas inwards, enhancing the accretion rate on to the primary and producing what is known as an electromagnetic precursor. In this context, using 3D hydrodynamic simulations, we study how an adiabatic circumprimary accretion disc responds to the varying gravitational potential as the secondary falls onto the more massive object. We included a cooling prescription controlled by the parameter \beta = \Omega t_{cool}, which will determine how strong the final accretion rate is: a hotter disc is thicker, and the tidal interaction is suppressed for the gas outside the binary plane. Our main results are that for scenarios where the gas cannot cool fast enough (\beta>30) the disc becomes thick and renders the system invisible, while for \beta<10 the strong cooling blocks any leakage on to the secondary's orbit, allowing an enhancement in the accretion rate two orders of magnitude stronger than the average through the rest of the simulation.


title: Deep Learning for Earth Image Segmentation based on Imperfect Polyline Labels with Annotation Errors

abstract: In recent years, deep learning techniques (e.g., U-Net, DeepLab) have achieved tremendous success in image segmentation. The performance of these models heavily relies on high-quality ground truth segment labels. Unfortunately, in many real-world problems, ground truth segment labels often have geometric annotation errors due to manual annotation mistakes, GPS errors, or visually interpreting background imagery at a coarse resolution. Such location errors will significantly impact the training performance of existing deep learning algorithms. Existing research on label errors either models ground truth errors in label semantics (assuming label locations to be correct) or models label location errors with simple square patch shifting. These methods cannot fully incorporate the geometric properties of label location errors. To fill the gap, this paper proposes a generic learning framework based on the EM algorithm to update deep learning model parameters and infer hidden true label locations simultaneously. Evaluations on a real-world hydrological dataset in the streamline refinement application show that the proposed framework outperforms baseline methods in classification accuracy (reducing the number of false positives by 67% and reducing the number of false negatives by 55%).


title: Transients generate memory and break hyperbolicity in stochastic enzymatic networks

abstract: The hyperbolic dependence of catalytic rate on substrate concentration is a classical result in enzyme kinetics, quantified by the celebrated Michaelis-Menten equation. The ubiquity of this relation in diverse chemical and biological contexts has recently been rationalized by a graph-theoretic analysis of deterministic reaction networks. Experiments, however, have revealed that "molecular noise" - intrinsic stochasticity at the molecular scale - leads to significant deviations from classical results and to unexpected effects like "molecular memory", i.e., the breakdown of statistical independence between turnover events. Here we show, through a new method of analysis, that memory and non-hyperbolicity have a common source in an initial, and observably long, transient peculiar to stochastic reaction networks of multiple enzymes. Networks of single enzymes do not admit such transients. The transient yields, asymptotically, to a steady-state in which memory vanishes and hyperbolicity is recovered. We propose new statistical measures, defined in terms of turnover times, to distinguish between the transient and steady states and apply these to experimental data from a landmark experiment that first observed molecular memory in a single enzyme with multiple binding sites. Our study shows that catalysis at the molecular level with more than one enzyme always contains a non-classical regime and provides insight on how the classical limit is attained.

categories: q-bio.MN physics.bio-ph physics.chem-ph q-bio.BM


title: Actions of Cusp Forms on Holomorphic Discrete Series and Von Neumann Algebras

abstract: A holomorphic discrete series representation $(L_\pi,H_\pi)$ of a connected semi-simple real Lie group $G$ is associated with an irreducible representation $(\pi,V_{\pi})$ of its maximal compact subgroup $K$. The underlying space $H_\pi$ can be realized as certain holomorphic $V_{\pi}$-valued functions on the bounded symmetric domain $\mathcal{D}\cong G/K$. By the Berezin quantization, we transfer $B(H_{\pi})$ into End$(V_{\pi})$-valued functions on $\mathcal{D}$. For a lattice $\Gamma$ of $G$, we give the formula of a faithful normal tracial state on the commutant $L_\pi(\Gamma)'$ of the group von Neumann algebra $L_{\pi}(\Gamma)''$. We find the Toeplitz operators $T_f$'s associated with essentially bounded End$(V_\pi)$-valued functions $f$'s on $\Gamma\backslash\mathcal{D}$ generate the entire commutant $L_\pi(\Gamma)'$: $$\overline{\{T_f|f\in L^\infty(\Gamma\backslash\mathcal{D},{\rm End}(V_\pi))\}}^{\text{w.o.}}=L_\pi(\Gamma)'.$$ For any cuspidal automorphic form $f$ defined on $G$ (or $\mathcal{D}$) for $\Gamma$, we find the associated Toeplitz-type operator $T_f$ intertwines the actions of $\Gamma$ on these square-integrable representations. Hence the composite operator of the form $T_g^{*}T_f$ belongs to $L_\pi(\Gamma)'$. We prove these operators span $L^{\infty}(\Gamma\backslash\mathcal{D})$ and $$\overline{\langle\{\text{span}_{f,g} T_g^{*}T_f\}\otimes {\rm End}(V_\pi)\rangle}^{\text{w.o.}}=L_\pi(\Gamma)',$$ where $f,g$ run through holomorphic cusp forms for $\Gamma$ of same types. If $\Gamma$ is an infinite conjugacy classes group, we obtain a $\text{II}_1$ factor from cusp forms.


title: STIL -- Simultaneous Slot Filling, Translation, Intent Classification, and Language Identification: Initial Results using mBART on MultiATIS++

abstract: Slot-filling, Translation, Intent classification, and Language identification, or STIL, is a newly-proposed task for multilingual Natural Language Understanding (NLU). By performing simultaneous slot filling and translation into a single output language (English in this case), some portion of downstream system components can be monolingual, reducing development and maintenance cost. Results are given using the multilingual BART model (Liu et al., 2020) fine-tuned on 7 languages using the MultiATIS++ dataset. When no translation is performed, mBART's performance is comparable to the current state of the art system (Cross-Lingual BERT by Xu et al. (2020)) for the languages tested, with better average intent classification accuracy (96.07% versus 95.50%) but worse average slot F1 (89.87% versus 90.81%). When simultaneous translation is performed, average intent classification accuracy degrades by only 1.7% relative and average slot F1 degrades by only 1.2% relative.


title: Enriching Word Embeddings with Temporal and Spatial Information

abstract: The meaning of a word is closely linked to sociocultural factors that can change over time and location, resulting in corresponding meaning changes. Taking a global view of words and their meanings in a widely used language, such as English, may require us to capture more refined semantics for use in time-specific or location-aware situations, such as the study of cultural trends or language use. However, popular vector representations for words do not adequately include temporal or spatial information. In this work, we present a model for learning word representation conditioned on time and location. In addition to capturing meaning changes over time and location, we require that the resulting word embeddings retain salient semantic and geometric properties. We train our model on time- and location-stamped corpora, and show using both quantitative and qualitative evaluations that it can capture semantics across time and locations. We note that our model compares favorably with the state-of-the-art for time-specific embedding, and serves as a new benchmark for location-specific embeddings.


title: A Modified Schmidl-Cox OFDM Timing Detector

abstract: We describe a simple modification of the Schmidl-Cox detector for establishing timing in OFDM transmissions that stabilizes performance in transitions from no-signal to signal, or vice-versa. Moreover, the proposed modification scales the detector's metric between 0 and 1 for all scenarios, simplifying threshold setting, and improves timing detector SNR.


title: Bongard-LOGO: A New Benchmark for Human-Level Concept Learning and Reasoning

abstract: Humans have an inherent ability to learn novel concepts from only a few samples and generalize these concepts to different situations. Even though today's machine learning models excel with a plethora of training data on standard recognition tasks, a considerable gap exists between machine-level pattern recognition and human-level concept learning. To narrow this gap, the Bongard problems (BPs) were introduced as an inspirational challenge for visual cognition in intelligent systems. Despite new advances in representation learning and learning to learn, BPs remain a daunting challenge for modern AI. Inspired by the original one hundred BPs, we propose a new benchmark Bongard-LOGO for human-level concept learning and reasoning. We develop a program-guided generation technique to produce a large set of human-interpretable visual cognition problems in action-oriented LOGO language. Our benchmark captures three core properties of human cognition: 1) context-dependent perception, in which the same object may have disparate interpretations given different contexts; 2) analogy-making perception, in which some meaningful concepts are traded off for other meaningful concepts; and 3) perception with a few samples but infinite vocabulary. In experiments, we show that the state-of-the-art deep learning methods perform substantially worse than human subjects, implying that they fail to capture core human cognition properties. Finally, we discuss research directions towards a general architecture for visual reasoning to tackle this benchmark.


title: Observation of a Chiral Wave Function in Twofold Degenerate Quadruple Weyl System BaPtGe

abstract: Topological states in quantum materials are defined by non-trivial topological invariants, such as the Chern number, which are properties of their bulk wave functions. A remarkable consequence of topological wave functions is the emergence of edge modes, a phenomenon known as bulk-edge correspondence, that gives rise to quantized or chiral physical properties. While edge modes are widely presented as signatures of non-trivial topology, how bulk wave functions can manifest explicitly topological properties remains unresolved. Here, using high-resolution inelastic x-ray spectroscopy (IXS) combined with first principles calculations, we report experimental signatures of chiral wave functions in the bulk phonon spectrum of BaPtGe, which we show to host a previously undiscovered twofold degenerate quadruple Weyl node. The chirality of the degenerate phononic wave function yields a non-trivial phonon dynamical structure factor, S(Q,$\omega$), along high-symmetry directions, that is in excellent agreement with numerical and model calculations. Our results establish IXS as a powerful tool to uncover topological wave functions, providing a key missing ingredient in the study of topological quantum matter.


title: Variational characterizations of weighted Hardy spaces and weighted $BMO$ spaces

abstract: This paper obtains new characterizations of weighted Hardy spaces and certain weighted $BMO$ type spaces via the boundedness of variation operators associated with approximate identities and their commutators, respectively.


title: Chiral charge-density wave in TiSe$_2$ due to photo-induced structural distortions

abstract: A variety of experiments have been carried out to establish the origin of the chiral charge-density wave transition in 1T-TiSe$_2$, which in turn has led to contradictory conclusions on the origin of this transition. Some studies suggest the transition is a phonon-driven structural distortion while other studies suggest it is an excitonic insulator phase transition that is accompanied by a lattice distortion. First, we propose these interpretations can be reconciled if one analyzes the available experimental and theoretical data within a formal definition of what constitutes an excitonic insulator as initially proposed by Keldysh and Kopaev. Next, we present pump-probe measurements of circularly polarized optical transitions and first-principles calculations where we highlight the importance of accounting for structural distortions to explain the finite chirality of optical transitions in the CDW phase. We show that at the elevated electronic temperature that occurs upon photoexcitation, there is a non-centrosymmetric structure that is near-degenerate in energy with the centrosymmetric charge density wave structure, which explains the finite chirality of the optical transitions observed in the CDW phase of TiSe$_2$.


title: Enhancing Fine-grained Sentiment Classification Exploiting Local Context Embedding

abstract: Target-oriented sentiment classification is a fine-grained task of natural language processing to analyze the sentiment polarity of the targets. To improve the performance of sentiment classification, many approaches proposed various attention mechanisms to capture the important context words of a target. However, previous approaches ignored the significant relatedness of a target's sentiment and its local context. This paper proposes a local context-aware network (LCA-Net), equipped with the local context embedding and local context prediction loss, to strengthen the model by emphasizing the sentiment information of the local context. The experimental results on three common datasets show that local context-aware network performs superior to existing approaches in extracting local context features. Besides, the local context-aware framework is easy to adapt to many models, with the potential to improve other target-level tasks.


title: SparTerm: Learning Term-based Sparse Representation for Fast Text Retrieval

abstract: Term-based sparse representations dominate the first-stage text retrieval in industrial applications, due to its advantage in efficiency, interpretability, and exact term matching. In this paper, we study the problem of transferring the deep knowledge of the pre-trained language model (PLM) to Term-based Sparse representations, aiming to improve the representation capacity of bag-of-words(BoW) method for semantic-level matching, while still keeping its advantages. Specifically, we propose a novel framework SparTerm to directly learn sparse text representations in the full vocabulary space. The proposed SparTerm comprises an importance predictor to predict the importance for each term in the vocabulary, and a gating controller to control the term activation. These two modules cooperatively ensure the sparsity and flexibility of the final text representation, which unifies the term-weighting and expansion in the same framework. Evaluated on MSMARCO dataset, SparTerm significantly outperforms traditional sparse methods and achieves state of the art ranking performance among all the PLM-based sparse models.


title: Supervised Heart Rate Tracking using Wrist-Type Photoplethysmographic (PPG) Signals during Physical Exercise without Simultaneous Acceleration Signals

abstract: PPG based heart rate (HR) monitoring has recently attracted much attention with the advent of wearable devices such as smart watches and smart bands. However, due to severe motion artifacts (MA) caused by wristband stumbles, PPG based HR monitoring is a challenging problem in scenarios where the subject performs intensive physical exercises. This work proposes a novel approach to the problem based on supervised learning by Neural Network (NN). By simulations on the benchmark datasets [1], we achieve acceptable estimation accuracy and improved run time in comparison with the literature. A major contribution of this work is that it alleviates the need to use simultaneous acceleration signals. The simulation results show that although the proposed method does not process the simultaneous acceleration signals, it still achieves the acceptable Mean Absolute Error (MAE) of 1.39 Beats Per Minute (BPM) on the benchmark data set.


title: XDA: Accurate, Robust Disassembly with Transfer Learning

abstract: Accurate and robust disassembly of stripped binaries is challenging. The root of the difficulty is that high-level structures, such as instruction and function boundaries, are absent in stripped binaries and must be recovered based on incomplete information. Current disassembly approaches rely on heuristics or simple pattern matching to approximate the recovery, but these methods are often inaccurate and brittle, especially across different compiler optimizations. We present XDA, a transfer-learning-based disassembly framework that learns different contextual dependencies present in machine code and transfers this knowledge for accurate and robust disassembly. We design a self-supervised learning task motivated by masked Language Modeling to learn interactions among byte sequences in binaries. The outputs from this task are byte embeddings that encode sophisticated contextual dependencies between input binaries' byte tokens, which can then be finetuned for downstream disassembly tasks. We evaluate XDA's performance on two disassembly tasks, recovering function boundaries and assembly instructions, on a collection of 3,121 binaries taken from SPEC CPU2017, SPEC CPU2006, and the BAP corpus. The binaries are compiled by GCC, ICC, and MSVC on x86/x64 Windows and Linux platforms over 4 optimization levels. XDA achieves 99.0% and 99.7% F1 score at recovering function boundaries and instructions, respectively, surpassing the previous state-of-the-art on both tasks. It also maintains speed on par with the fastest ML-based approach and is up to 38x faster than hand-written disassemblers like IDA Pro. We release the code of XDA at https://github.com/CUMLSec/XDA.


title: Searching anomalous polarization modes of stochastic gravitational wave background with LISA and Taiji

abstract: The vector and scalar polarization modes of gravitational waves do not exist in General Relativity, and their detection would have significant impacts on fundamental physics. In this paper, we explored the detectability of these anomalous polarization modes in a gravitational wave background around 1 mHz with the future LISA-Taiji network. The inherent geometrical symmetry of the network largely simplifies the correlation analysis. By taking a suitable linear combination of the correlated outputs, the contribution of the standard tensor modes can be canceled algebraically, and the anomalous modes can be exclusively examined. We provide concise expressions for the signal-to-noise ratios of the anomalous modes with this cancellation method. We also discuss the possibility of separately estimating the amplitudes of the vector and scalar modes, using the overall frequency dependence of the associated overlap reduction functions.


title: Controlling $T_c$ of Iridium Films Using the Proximity Effect

abstract: A superconducting Transition-Edge Sensor (TES) with low-$T_c$ is essential in a high resolution calorimetric detection. With a motivation of developing sensitive calorimeters for applications in cryogenic neutrinoless double beta decay searches, we have been investigating methods to reduce the $T_c$ of an Ir film down to 20 mK. Utilizing the proximity effect between a superconductor and a normal metal, we found two room temperature fabrication recipes of making Ir-based low-$T_c$ films. In the first approach, an Ir film sandwiched between two Au films, a Au/Ir/Au trilayer, has a tunable $T_c$ in the range of 20-100 mK depending on the relative thicknesses. In the second approach, a paramagnetic Pt thin film is used to create Ir/Pt bilayer with a tunable $T_c$ in the same range. We present detailed study of fabrication and characterization of Ir-based low-$T_c$ films, and compare the experimental results to theoretical models. We show that Ir-based films with predictable and reproducible critical temperature can be consistently fabricated for use in large scale detector applications.

categories: cond-mat.supr-con hep-ex nucl-ex physics.ins-det


title: The unique global solvability of the nonhomogeneous incompressible asymmetric fluids with vacuum

abstract: The present paper deals with the nonhomogeneous incompressible asymmetric fluids equations in dimension $d= 2,3$. The aim is to prove the unique global solvability of the system with only bounded nonnegative initial density and $H^{1}$ initial velocities. We first construct the global existence of the solution with large data in 2-D. Next, we establish the existence of local in time solution for arbitrary large data and global in time for some smallness conditions in 3-D. Finally, the uniqueness of the solution is proved under quite soft assumptions about its regularity through a Lagrangian approach. In particular, the initial vacuum is allowed.


title: Proof Repair across Type Equivalences

abstract: We describe a new approach to automatically repairing broken proofs in the Coq proof assistant in response to changes in types. Our approach combines a configurable proof term transformation with a decompiler from proof terms to tactic scripts. The proof term transformation implements transport across equivalences in a way that removes references to the old version of the changed type and does not rely on axioms beyond those Coq assumes. We have implemented this approach in PUMPKIN Pi, an extension to the PUMPKIN PATCH Coq plugin suite for proof repair. We demonstrate PUMPKIN Pi's flexibility on eight case studies, including supporting a benchmark from a user study, easing development with dependent types, porting functions and proofs between unary and binary numbers, and supporting an industrial proof engineer to interoperate between Coq and other verification tools more easily.


title: Pulse Shape Discrimination of CsI(Tl) with a Photomultiplier Tube and MPPCs

abstract: In this study, we evaluate and compare the pulse shape discrimination (PSD) performance of multipixel photon counters (MPPCs, also known as silicon photomultiphers - SiPMs) with that of a typical photomultiplier tube (PMT) when testing using CsI(Tl) scintillators. We use the charge comparison method, whereby we discriminate different types of particles by the ratio of charges integrated within two time-gates (the delayed part and the entire digitized waveform). For a satisfactory PSD performance, a setup should generate many photoelectrons (p.e.) and collect their charges efficiently. The PMT setup generates more p.e. than the MPPC setup does. With the same digitizer and the same long time-gate (the entire digitized waveform), the PMT setup is also better in charge collection. Therefore, the PMT setup demonstrates better PSD performance. We subsequently test the MPPC setup using a new data acquisition (DAQ) system. Using this new DAQ, the long time-gate is extended by nearly four times the length when using the previous digitizer. With this longer time-gate, we collect more p.e. at the tail part of the pulse and almost all the charges of the total collected p.e. Thus, the PSD performance of the MPPC setup is improved significantly. This study also provides an estimation of the short time-gate (the delayed part of the digitized waveform) that can give a satisfactory PSD performance without an extensive analysis to optimize this gate.


title: Yau Type Gradient Estimates For $\Delta u + au(\log u)^{p}+bu=0$ On Riemannian Manifolds

abstract: In this paper, we consider the gradient estimates of the positive solutions to the following equation defined on a complete Riemannian manifold $(M, g)$ $$\Delta u + au(\log u)^{p}+bu=0,$$ where $a, b\in \mathbb{R}$ and $p$ is a rational number with $p=\frac{k_1}{2k_2+1}\geq2$ where $k_1$ and $k_2$ are positive integer numbers. we obtain the gradient bound of a positive solution to the equation which does not depend on the bounds of the solution and the Laplacian of the distance function on $(M, g)$. Our results can be viewed as a natural extension of Yau's estimates on positive harmonic function.


title: Optimal control problems for 1D parabolic state-systems of KWC types with dynamic boundary conditions

abstract: In this paper, we consider a class of optimal control problems governed by 1D parabolic state-systems of KWC types with dynamic boundary conditions. The state-systems are based on a phase-field model of grain boundary motion, proposed in [Kobayashi--Warren--Carter, Physica D, 140, 141--150, 2000], and in the context, the dynamic boundary conditions are supposed to reproduce the transmitted heat exchanges between interior and boundary of a polycrystal body. Our optimal control problems are labeled by using a constant $ \varepsilon \geq 0 $, and roughly summarized, the case when $ \varepsilon = 0 $ and the cases when $ \varepsilon > 0 $ correspond to the physically realistic setting, and its regularized approximating ones, respectively. Under suitable assumptions, the mathematical results concerned with: the solvability and continuous dependence for the state-systems; the solvability and $ \varepsilon $-dependence of optimal control problems; and the first order necessary optimality conditions in the problems when $ \varepsilon > 0 $ and the limiting optimality condition as $ \varepsilon \downarrow 0 $; will be obtained in forms of three Main Theorems of this paper.


title: Nonlinear Covariance Steering using Variational Gaussian Process Predictive Models

abstract: In this work, we consider the problem of steering the first two moments of the uncertain state of an unknown discrete-time stochastic nonlinear system to a given terminal distribution in finite time. Toward that goal, first, a non-parametric predictive model is learned from a set of available training data points using stochastic variational Gaussian process regression: a powerful and scalable machine learning tool for learning distributions over arbitrary nonlinear functions. Second, we formulate a tractable nonlinear covariance steering algorithm that utilizes the Gaussian process predictive model to compute a feedback policy that will drive the distribution of the state of the system close to the goal distribution. In particular, we implement a greedy covariance steering control policy that linearizes at each time step the Gaussian process model around the latest predicted mean and covariance, solves the linear covariance steering control problem, and applies only the first control law. The state uncertainty under the latest feedback control policy is then propagated using the unscented transform with the learned Gaussian process predictive model and the algorithm proceeds to the next time step. Numerical simulations illustrating the main ideas of this paper are also presented.


title: Planning a Sequence of Base Positions for a Mobile Manipulator to Perform Multiple Pick-and-Place Tasks

abstract: In this paper, we present a planner that plans a sequence of base positions for a mobile manipulator to efficiently and robustly collect objects stored in distinct trays. We achieve high efficiency by exploring the common areas where a mobile manipulator can grasp objects stored in multiple trays simultaneously and move the mobile manipulator to the common areas to reduce the time needed for moving the mobile base. We ensure robustness by optimizing the base position with the best clearance to positioning uncertainty so that a mobile manipulator can complete the task even if there is a certain deviation from the planned base positions. Besides, considering different styles of object placement in the tray, we analyze feasible schemes for dynamically updating the base positions based on either the remaining objects or the target objects to be picked in one round of the tasks. In the experiment part, we examine our planner on various scenarios, including different object placement: (1) Regularly placed toy objects; (2) Randomly placed industrial parts; and different schemes for online execution: (1) Apply globally static base positions; (2) Dynamically update the base positions. The experiment results demonstrate the efficiency, robustness and feasibility of the proposed method.


title: Towards Multi-Robot Task-Motion Planning for Navigation in Belief Space

abstract: Autonomous robots operating in large knowledgeintensive domains require planning in the discrete (task) space and the continuous (motion) space. In knowledge-intensive domains, on the one hand, robots have to reason at the highestlevel, for example the regions to navigate to or objects to be picked up and their properties; on the other hand, the feasibility of the respective navigation tasks have to be checked at the controller execution level. Moreover, employing multiple robots offer enhanced performance capabilities over a single robot performing the same task. To this end, we present an integrated multi-robot task-motion planning framework for navigation in knowledge-intensive domains. In particular, we consider a distributed multi-robot setting incorporating mutual observations between the robots. The framework is intended for motion planning under motion and sensing uncertainty, which is formally known as belief space planning. The underlying methodology and its limitations are discussed, providing suggestions for improvements and future work. We validate key aspects of our approach in simulation.


title: Evaluating real-time probabilistic forecasts with application to National Basketball Association outcome prediction

abstract: Motivated by the goal of evaluating real-time forecasts of home team win probabilities in the National Basketball Association, we develop new tools for measuring the quality of continuously updated probabilistic forecasts. This includes introducing calibration surface plots, and simple graphical summaries of them, to evaluate at a glance whether a given continuously updated probability forecasting method is well-calibrated, as well as developing statistical tests and graphical tools to evaluate the skill, or relative performance, of two competing continuously updated forecasting methods. These tools are studied by means of a Monte Carlo simulation study of simulated basketball games, and demonstrated in an application to evaluate the continuously updated forecasts published by the United States-based multinational sports network ESPN on its principle webpage {\tt espn.com}. This application lends statistical evidence that the forecasts published there are well-calibrated, and exhibit improved skill over several na\"ive models, but do not demonstrate significantly improved skill over simple logistic regression models based solely on a measurement of each teams' relative strength, and the evolving score difference throughout the game.


title: Lipschitz minimizers for a class of integral functionals under the bounded slope condition

abstract: We consider the functional $\int_\Omega g(\nabla u+\textbf X^\ast)d\mathscr L^{2n}$ where $g$ is convex and $\textbf X^\ast(x,y)=2(-y,x)$ and we study the minimizers in $BV(\Omega)$ of the associated Dirichlet problem. We prove that, under the bounded slope condition on the boundary datum, and suitable conditions on $g$, there exists a unique minimizer which is also Lipschitz continuous.


title: Vectorial dispersive shock waves on an incoherent landscape

abstract: We study numerically and experimentally the impact of temporal randomness on the formation of analogue optical blast-waves in nonlinear fiber optics. The principle-of-operation is based on a two-components nonlinear interaction occurring between a partially coherent probe wave co-propagating in a normally dispersive optical fiber together with an orthogonally polarized intense short pulse. The cross-polarized interaction induces a dual phase-singularity in the probe profile which leads to the formation of two sharp fronts of opposite velocities. An optical blast-wave is then generated and leads to an expanding rarefication area surrounded by two dispersive shock waves which regularize the shock onto the probe landscape. Here we focus our study on the impact of randomness in the shock formation. In particular, we show that the lack of coherence into the probe wave acts as a strong diffusive term, which is able to hamper or inhibit the shock formation. Our experimental observations are confirmed by numerical predictions based on a system of two incoherently coupled nonlinear Schr{\"o}dinger Manakov equations.


title: An Empirical Investigation Towards Efficient Multi-Domain Language Model Pre-training

abstract: Pre-training large language models has become a standard in the natural language processing community. Such models are pre-trained on generic data (e.g. BookCorpus and English Wikipedia) and often fine-tuned on tasks in the same domain. However, in order to achieve state-of-the-art performance on out of domain tasks such as clinical named entity recognition and relation extraction, additional in domain pre-training is required. In practice, staged multi-domain pre-training presents performance deterioration in the form of catastrophic forgetting (CF) when evaluated on a generic benchmark such as GLUE. In this paper we conduct an empirical investigation into known methods to mitigate CF. We find that elastic weight consolidation provides best overall scores yielding only a 0.33% drop in performance across seven generic tasks while remaining competitive in bio-medical tasks. Furthermore, we explore gradient and latent clustering based data selection techniques to improve coverage when using elastic weight consolidation and experience replay methods.


title: Riesz's Theorem for Lumer's Hardy Spaces

abstract: In this note we obtain a version of the well-known Riesz's theorem on conjugate harmonic functions for Lumer's Hardy spaces $(Lh)^2(\Omega)$ on arbitrary domains $\Omega$: If a real-valued harmonic function $U\in (Lh)^2(\Omega)$ has a harmonic conjugate $V$ on $\Omega$ (i.e., a real-valued harmonic function such that $U+ iV$ is analytic on $\Omega$), then $U+iV$ also belongs to $(Lh)^2(\Omega)$, and for the normalized conjugate we have the norm estimate $\|U+iV\|_{(Lh)^2(\Omega)}\le\sqrt{2} \|U\|_{(Lh)^2(\Omega)}$, with the best possible constant.


title: Light tetraquark states with the exotic quantum number $J^{PC} = 3^{-+}$

abstract: We apply the method of QCD sum rules to study the $s q \bar s \bar q$ tetraquark states with the exotic quantum number $J^{PC} = 3^{-+}$, and extract mass of the lowest-lying state to be $2.33^{+0.19}_{-0.16}$ GeV. To construct the relevant tetraquark currents we need to explicitly add the covariant derivative operator. Our systematical analysis on their relevant interpolating currents indicates that: a) this state well decays into the $P$-wave $\rho\phi/\omega\phi$ channel but not into the $\rho f_2(1525)/\omega f_2(1525)/\phi f_2(1270)$ channels, and b) it well decays into the $K^*(892) \bar K_2^*(1430)$ channel but not into the $P$-wave $K^*(892) \bar K^*(892)$ channel.


title: Entanglement gap, corners, and symmetry breaking

abstract: We investigate the finite-size scaling of the lowest entanglement gap $\delta\xi$ in the ordered phase of the two-dimensional quantum spherical model (QSM). The entanglement gap decays as $\delta\xi=\Omega/\sqrt{L\ln(L)}$. This is in contrast with the purely logarithmic behaviour as $\delta\xi=\pi^2/\ln(L)$ at the critical point. The faster decay in the ordered phase reflects the presence of magnetic order. We analytically determine the constant $\Omega$, which depends on the low-energy part of the model dispersion and on the geometry of the bipartition. In particular, we are able to compute the corner contribution to $\Omega$, at least for the case of a square corner.

categories: cond-mat.stat-mech cond-mat.str-el hep-th math-ph math.MP quant-ph


title: Effective Regularization Through Loss-Function Metalearning

abstract: Evolutionary optimization, such as the TaylorGLO method, can be used to discover novel, customized loss functions for deep neural networks, resulting in improved performance, faster training, and improved data utilization. A likely explanation is that such functions discourage overfitting, leading to effective regularization. This paper demonstrates theoretically that this is indeed the case for TaylorGLO: Decomposition of learning rules makes it possible to characterize the training dynamics and show that the loss functions evolved by TaylorGLO balance the pull to zero error, and a push away from it to avoid overfitting. They may also automatically take advantage of label smoothing. This analysis leads to an invariant that can be utilized to make the metalearning process more efficient in practice; the mechanism also results in networks that are robust against adversarial attacks. Loss-function evolution can thus be seen as a well-founded new aspect of metalearning in neural networks.


title: Error trade-off relations for two-parameter unitary model with commuting generators

abstract: We investigate whether a trade-off relation between the diagonal elements of the mean square error matrix exists for the two-parameter unitary models with mutually commuting generators. We show that the error trade-off relation which exists in our models of a finite dimension system is a generic phenomenon in the sense that it occurs with a finite volume in the spate space. We analyze a qutrit system to show that there can be an error trade-off relation given by the SLD and RLD Cramer-Rao bounds that intersect each other. First, we analyze an example of the reference state showing the non-trivial trade-off relation numerically, and find that its eigenvalues must be in a certain range to exhibit the trade-off relation. For another example, one-parameter family of reference states, we analytically show that the non-trivial relation always exists and that the range where the trade-off relation exists is up to about a half of the possible range.


title: RAiSERed: radio continuum redshifts for lobed AGNs

abstract: Next-generation radio surveys are expected to detect tens of millions of active galactic nuclei (AGN) with a median redshift of z > 1. Beyond targeted surveys, the vast majority of these objects will not have spectroscopic redshifts, whilst photometric redshifts for high-redshift AGNs are of limited quality, and even then require optical and infrared photometry. We propose a new approach to measure the redshifts of lobed radio galaxies based exclusively on radio-frequency imaging and broadband radio photometry. Specifically, our algorithm uses the lobe flux density, angular size and width, and spectral shape to derive probability density functions for the most likely source redshift based on the Radio AGN in Semi-analytic Environments (RAiSE) dynamical model. The full physically based model explains 70% of the variation in the spectroscopic redshifts of a high-redshift (2 < z < 4) sample of radio AGNs, compared to at most 27% for any one of the observed attributes in isolation. We find that upper bounds on the angular size, as expected for unresolved sources, are sufficient to yield accurate redshift measurements at z > 2. The error in the model upon calibration using at least nine sources with known spectroscopic redshifts is <14% in redshift (as 1 + z) across all redshifts. We provide python code for the calculation and calibration of our radio continuum redshifts in an online library.


title: A recursion theoretic foundation of computation over real numbers

abstract: We define a class of computable functions over real numbers using functional schemes similar to the class of primitive and partial recursive functions defined by G\"odel and Kleene. We show that this class of functions can also be characterized by master-slave machines, which are Turing machine like devices. The proof of the characterization gives a normal form theorem in the style of Kleene. Furthermore, this characterization is a natural combination of two most influential theories of computation over real numbers, namely, the type-two theory of effectivity (TTE) (see, for example, Weihrauch) and the Blum-Shub-Smale model of computation (BSS). Under this notion of computability, the recursive (or computable) subsets of real numbers are exactly effective $\Delta^0_2$ sets.


title: Data Transfer Approaches to Improve Seq-to-Seq Retrosynthesis

abstract: Retrosynthesis is a problem to infer reactant compounds to synthesize a given product compound through chemical reactions. Recent studies on retrosynthesis focus on proposing more sophisticated prediction models, but the dataset to feed the models also plays an essential role in achieving the best generalizing models. Generally, a dataset that is best suited for a specific task tends to be small. In such a case, it is the standard solution to transfer knowledge from a large or clean dataset in the same domain. In this paper, we conduct a systematic and intensive examination of data transfer approaches on end-to-end generative models, in application to retrosynthesis. Experimental results show that typical data transfer methods can improve test prediction scores of an off-the-shelf Transformer baseline model. Especially, the pre-training plus fine-tuning approach boosts the accuracy scores of the baseline, achieving the new state-of-the-art. In addition, we conduct a manual inspection for the erroneous prediction results. The inspection shows that the pre-training plus fine-tuning models can generate chemically appropriate or sensible proposals in almost all cases.


title: A Parallel Down-Up Fusion Network for Salient Object Detection in Optical Remote Sensing Images

abstract: The diverse spatial resolutions, various object types, scales and orientations, and cluttered backgrounds in optical remote sensing images (RSIs) challenge the current salient object detection (SOD) approaches. It is commonly unsatisfactory to directly employ the SOD approaches designed for nature scene images (NSIs) to RSIs. In this paper, we propose a novel Parallel Down-up Fusion network (PDF-Net) for SOD in optical RSIs, which takes full advantage of the in-path low- and high-level features and cross-path multi-resolution features to distinguish diversely scaled salient objects and suppress the cluttered backgrounds. To be specific, keeping a key observation that the salient objects still are salient no matter the resolutions of images are in mind, the PDF-Net takes successive down-sampling to form five parallel paths and perceive scaled salient objects that are commonly existed in optical RSIs. Meanwhile, we adopt the dense connections to take advantage of both low- and high-level information in the same path and build up the relations of cross paths, which explicitly yield strong feature representations. At last, we fuse the multiple-resolution features in parallel paths to combine the benefits of the features with different resolutions, i.e., the high-resolution feature consisting of complete structure and clear details while the low-resolution features highlighting the scaled salient objects. Extensive experiments on the ORSSD dataset demonstrate that the proposed network is superior to the state-of-the-art approaches both qualitatively and quantitatively.


title: Visualizing probability distributions across bivariate cyclic temporal granularities

abstract: Deconstructing a time index into time granularities can assist in exploration and automated analysis of large temporal data sets. This paper describes classes of time deconstructions using linear and cyclic time granularities. Linear granularities respect the linear progression of time such as hours, days, weeks and months. Cyclic granularities can be circular such as hour-of-the-day, quasi-circular such as day-of-the-month, and aperiodic such as public holidays. The hierarchical structure of granularities creates a nested ordering: hour-of-the-day and second-of-the-minute are single-order-up. Hour-of-the-week is multiple-order-up, because it passes over day-of-the-week. Methods are provided for creating all possible granularities for a time index. A recommendation algorithm provides an indication whether a pair of granularities can be meaningfully examined together (a "harmony"), or when they cannot (a "clash"). Time granularities can be used to create data visualizations to explore for periodicities, associations and anomalies. The granularities form categorical variables (ordered or unordered) which induce groupings of the observations. Assuming a numeric response variable, the resulting graphics are then displays of distributions compared across combinations of categorical variables. The methods implemented in the open source R package `gravitas` are consistent with a tidy workflow, with probability distributions examined using the range of graphics available in `ggplot2`.