title: Weighted Bures Length Uncovers Quantum State Sensitivity

abstract: The unitarity of quantum evolutions implies that the overlap between two initial states does not change in time. This property is commonly believed to explain the lack of state sensitivity in quantum theory, a feature that is prevailing in classical chaotic systems. However, a distance between two points in classical phase space is a completely different mathematical concept than an overlap distance between two points in Hilbert space. There is a possibility that state sensitivity in quantum theory can be uncovered with a help of some other metric. Here we show that the recently introduced Weighted Bures Length (WBL) achieves this task. In particular, we numerically study a cellular automaton-like unitary evolution of N qubits, known as Rule 54, and apply WBL to show that a single-qubit perturbation of a random initial state: (a) grows linearly in time under the nearest neighbour interaction on a cycle, (b) appears to grow exponentially in time under interaction given by a random bipartite graph.


title: Generalized Zero-Shot Learning using Multimodal Variational Auto-Encoder with Semantic Concepts

abstract: With the ever-increasing amount of data, the central challenge in multimodal learning involves limitations of labelled samples. For the task of classification, techniques such as meta-learning, zero-shot learning, and few-shot learning showcase the ability to learn information about novel classes based on prior knowledge. Recent techniques try to learn a cross-modal mapping between the semantic space and the image space. However, they tend to ignore the local and global semantic knowledge. To overcome this problem, we propose a Multimodal Variational Auto-Encoder (M-VAE) which can learn the shared latent space of image features and the semantic space. In our approach we concatenate multimodal data to a single embedding before passing it to the VAE for learning the latent space. We propose the use of a multi-modal loss during the reconstruction of the feature embedding through the decoder. Our approach is capable to correlating modalities and exploit the local and global semantic knowledge for novel sample predictions. Our experimental results using a MLP classifier on four benchmark datasets show that our proposed model outperforms the current state-of-the-art approaches for generalized zero-shot learning.


title: Bayesian Time-Varying Tensor Vector Autoregressive Models for Dynamic Effective Connectivity

abstract: In contemporary neuroscience, a key area of interest is dynamic effective connectivity, which is crucial for understanding the dynamic interactions and causal relationships between different brain regions. Dynamic effective connectivity can provide insights into how brain network interactions are altered in neurological disorders such as dyslexia. Time-varying vector autoregressive (TV-VAR) models have been employed to draw inferences for this purpose. However, their significant computational requirements pose challenges, since the number of parameters to be estimated increases quadratically with the number of time series. In this paper, we propose a computationally efficient Bayesian time-varying VAR approach. For dealing with large-dimensional time series, the proposed framework employs a tensor decomposition for the VAR coefficient matrices at different lags. Dynamically varying connectivity patterns are captured by assuming that at any given time only a subset of components in the tensor decomposition is active. Latent binary time series select the active components at each time via an innovative and parsimonious Ising model in the time-domain. Furthermore, we propose parsity-inducing priors to achieve global-local shrinkage of the VAR coefficients, determine automatically the rank of the tensor decomposition and guide the selection of the lags of the auto-regression. We show the performances of our model formulation via simulation studies and data from a real fMRI study involving a book reading experiment.


title: Cascading failures in anisotropic interdependent networks of spatial modular structures

abstract: The structure of real-world multilayer infrastructure systems usually exhibits anisotropy due to constraints of the embedding space. For example, geographical features like mountains, rivers and shores influence the architecture of critical infrastructure networks. Moreover, such spatial networks are often non-homogeneous but rather have a modular structure with dense connections within communities and sparse connections between neighboring communities. When the networks of the different layers are interdependent, local failures and attacks may propagate throughout the system. Here we study the robustness of spatial interdependent networks which are both anisotropic and heterogeneous. We also evaluate the effect of localized attacks having different geometrical shapes. We find that anisotropic networks are more robust against localized attacks and that anisotropic attacks, surprisingly, even on isotropic structures, are more effective than isotropic attacks.


title: Deep Learning Partial Least Squares

abstract: High dimensional data reduction techniques are provided by using partial least squares within deep learning. Our framework provides a nonlinear extension of PLS together with a disciplined approach to feature selection and architecture design in deep learning. This leads to a statistical interpretation of deep learning that is tailor made for predictive problems. We can use the tools of PLS, such as scree-plot, bi-plot to provide model diagnostics. Posterior predictive uncertainty is available using MCMC methods at the last layer. Thus we achieve the best of both worlds: scalability and fast predictive rule construction together with uncertainty quantification. Our key construct is to employ deep learning within PLS by predicting the output scores as a deep learner of the input scores. As with PLS our X-scores are constructed using SVD and applied to both regression and classification problems and are fast and scalable. Following Frank and Friedman 1993, we provide a Bayesian shrinkage interpretation of our nonlinear predictor. We introduce a variety of new partial least squares models: PLS-ReLU, PLS-Autoencoder, PLS-Trees and PLS-GP. To illustrate our methodology, we use simulated examples and the analysis of preferences of orange juice and predicting wine quality as a function of input characteristics. We also illustrate Brillinger's estimation procedure to provide the feature selection and data dimension reduction. Finally, we conclude with directions for future research.


title: Planar and Toroidal Morphs Made Easier

abstract: We present simpler algorithms for two closely related morphing problems, both based on the barycentric interpolation paradigm introduced by Floater and Gotsman, which is in turn based on Floater's asymmetric extension of Tutte's classical spring-embedding theorem. First, we give a much simpler algorithm to construct piecewise-linear morphs between planar straight-line graphs. Specifically, given isomorphic straight-line drawings $\Gamma_0$ and $\Gamma_1$ of the same 3-connected planar graph $G$, with the same convex outer face, we construct a morph from $\Gamma_0$ to $\Gamma_1$ that consists of $O(n)$ unidirectional morphing steps, in $O(n^{1+\omega/2})$ time. Our algorithm entirely avoids the classical edge-collapsing strategy dating back to Cairns; instead, in each morphing step, we interpolate the pair of weights associated with a single edge. Second, we describe a natural extension of barycentric interpolation to geodesic graphs on the flat torus. Barycentric interpolation cannot be applied directly in this setting, because the linear systems defining intermediate vertex positions are not necessarily solvable. We describe a simple scaling strategy that circumvents this issue. Computing the appropriate scaling requires $O(n^{\omega/2})$ time, after which we can can compute the drawing at any point in the morph in $O(n^{\omega/2})$ time. Our algorithm is considerably simpler than the recent algorithm of Chambers et al. (arXiv:2007.07927) and produces more natural morphs. Our techniques also yield a simple proof of a conjecture of Connelly et al. for geodesic torus triangulations.


title: Radar Voxel Fusion for 3D Object Detection

abstract: Automotive traffic scenes are complex due to the variety of possible scenarios, objects, and weather conditions that need to be handled. In contrast to more constrained environments, such as automated underground trains, automotive perception systems cannot be tailored to a narrow field of specific tasks but must handle an ever-changing environment with unforeseen events. As currently no single sensor is able to reliably perceive all relevant activity in the surroundings, sensor data fusion is applied to perceive as much information as possible. Data fusion of different sensors and sensor modalities on a low abstraction level enables the compensation of sensor weaknesses and misdetections among the sensors before the information-rich sensor data are compressed and thereby information is lost after a sensor-individual object detection. This paper develops a low-level sensor fusion network for 3D object detection, which fuses lidar, camera, and radar data. The fusion network is trained and evaluated on the nuScenes data set. On the test set, fusion of radar data increases the resulting AP (Average Precision) detection score by about 5.1% in comparison to the baseline lidar network. The radar sensor fusion proves especially beneficial in inclement conditions such as rain and night scenes. Fusing additional camera data contributes positively only in conjunction with the radar fusion, which shows that interdependencies of the sensors are important for the detection result. Additionally, the paper proposes a novel loss to handle the discontinuity of a simple yaw representation for object detection. Our updated loss increases the detection and orientation estimation performance for all sensor input configurations. The code for this research has been made available on GitHub.


title: A game theoretical approximation for a parabolic/elliptic system with different operators

abstract: In this paper we find viscosity solutions to a coupled system composed by two equations, the first one is parabolic and driven by the infinity Laplacian while the second one is elliptic and involves the usual Laplacian. We prove that there is a two-player zero-sum game played in two different boards with different rules in each board (in the first one we play a Tug-of-War game taking the number of plays into consideration and in the second board we move at random) whose value functions converge uniformly to a viscosity solution to the PDE system.


title: Accelerating Recurrent Neural Networks for Gravitational Wave Experiments

abstract: This paper presents novel reconfigurable architectures for reducing the latency of recurrent neural networks (RNNs) that are used for detecting gravitational waves. Gravitational interferometers such as the LIGO detectors capture cosmic events such as black hole mergers which happen at unknown times and of varying durations, producing time-series data. We have developed a new architecture capable of accelerating RNN inference for analyzing time-series data from LIGO detectors. This architecture is based on optimizing the initiation intervals (II) in a multi-layer LSTM (Long Short-Term Memory) network, by identifying appropriate reuse factors for each layer. A customizable template for this architecture has been designed, which enables the generation of low-latency FPGA designs with efficient resource utilization using high-level synthesis tools. The proposed approach has been evaluated based on two LSTM models, targeting a ZYNQ 7045 FPGA and a U250 FPGA. Experimental results show that with balanced II, the number of DSPs can be reduced up to 42% while achieving the same IIs. When compared to other FPGA-based LSTM designs, our design can achieve about 4.92 to 12.4 times lower latency.


title: Stochastic optimization for dynamic pricing

abstract: We consider the problem of supply and demand balancing that is stated as a minimization problem for the total expected revenue function describing the behavior of both consumers and suppliers. In the considered market model we assume that consumers follow the discrete choice demand model, while suppliers are equipped with some quantity adjustment costs. The resulting optimization problem is smooth and convex making it amenable for application of efficient optimization algorithms with the aim of automatically setting prices for online marketplaces. We propose to use stochastic gradient methods to solve the above problem. We interpret the stochastic oracle as a response to the behavior of a random market participant, consumer or supplier. This allows us to interpret the considered algorithms and describe a suitable behavior of consumers and suppliers that leads to fast convergence to the equilibrium in a close to the real marketplace environment.


title: From Single to Multi Mode Lasing: The role of materials revealed in optical simulations

abstract: Comparative study of thin film Cholesteric Liquid Crystal (CLC) lasers made from different materials and optically pumped by external solid state laser reveals a striking dependence of lasing behaviour (ranging from single mode at the edge of the selective reflection band to multimode lasing) on the morphology and microstructure of CLC films. The materials studied belong to two groups: low molar mass liquid crystals and polymers. It is shown that the orientation of individual chiral domains and fluctuations in helical pitch contribute significantly to the type of lasing displayed by the material. Different ways of preparing CLC cells that lead to predominantly one type of lasing are discussed. The importance of variations of the helical pitch and domain orientation in producing single and multimode lasing is justified by optical simulations (4x4 matrix method) of lasing in multi-layered samples.


title: Network utility maximization by updating individual transmission rates

abstract: This paper discusses the problem of maximizing the total data transmission utility of the computer network. The total utility is defined as the sum of the individual (corresponding to each node in the network) utilities that are concave functions of the data transmission rate. For the case of non-strongly concave utilities, we propose an approach based on the use of a fast gradient method to optimize a dually smoothed objective function. As an alternative approach, we introduce stochastic oracles for the problem under consideration and interpret them as the messages on the state of some individual node to use randomized switching mirror descent to solve the problem above. We propose interpretations of both described approaches allowing the effective implementation of the protocols of their operation in the real-life computer networks environment, taking into account the distributed information storage and the restricted communication capabilities. The numerical experiments were carried out to compare the proposed approaches on sythetic examples of network architectures.


title: JSAnalyzer: A Web Developer Tool for Simplifying Mobile Pages Through JavaScript Optimizations

abstract: The amount of JavaScript embedded in Web pages has substantially grown in the past decade, leading to large and complex pages that are computationally intensive for mobile devices. In this paper, we propose JSAnalyzer, an easy-to-use tool that enables Web developers to quickly optimize and generate simpler versions of existing web pages for mobile users. JSAnalyzer can selectively enable or disable JavaScript elements in a page while visually observing their impact, such that non-critical elements can be removed without sacrificing the visual content or the interactive functionality. Our quantitative evaluation results show that JSAnalyzer achieves more than 88% relative increase in performance scoring for low-end mobile phones (i.e., from 32% to 60%), and reduces the page load time by 30%. A qualitative study of 22 users shows that JSAnalyzer maintains more than 90% visual similarity to the original pages, whereas a developer evaluation study conducted with 23 developers shows that JSAnalyzer scores more than 80% in terms of usefulness and usability while retaining the page content and functional features. Additionally, we show that JSAnalyzer outperforms state-of-the-art solutions such as JSCleaner and Google AMP.


title: Higher limits over the fusion orbit category

abstract: The fusion orbit category $\overline{\mathcal F _{\mathcal C}} (G)$ of a discrete group $G$ over a collection $\mathcal C$ is the category whose objects are the subgroups $H$ in $\mathcal C$, and whose morphisms $H \to K$ are given by the $G$-maps $G/H \to G/K$ modulo the action of the centralizer group $C_G(H)$. We show that the higher limits over $\overline{\mathcal F _{\mathcal C}} (G)$ can be computed using the hypercohomology spectral sequences coming from the Dwyer $G$-spaces for centralizer and normalizer decompositions for $G$. If $G$ is the discrete group realizing a saturated fusion system $\mathcal F$, then these hypercohomology spectral sequences give two spectral sequences that converge to the cohomology of the centric orbit category ${\mathcal O}^c (\mathcal F)$. This allows us to apply our results to the sharpness problem for the subgroup decomposition of a $p$-local finite group. We prove that the subgroup decomposition for every $p$-local finite group is sharp (over $\mathcal F$-centric subgroups) if it is sharp for every $p$-local finite group with nontrivial center. We also show that for every $p$-local finite group $(S, \mathcal F, \mathcal L)$, the subgroup decomposition is sharp if and only if the normalizer decomposition is sharp.


title: Using relative weight analysis with residualization to detect relevant nonlinear interaction effects in ordinary and logistic regressions

abstract: Relative weight analysis is a classic tool for detecting whether one variable or interaction in a model is relevant. In this study, we focus on the construction of relative weights for non-linear interactions using restricted cubic splines. Our aim is to provide an accessible method to analyze a multivariate model and identify one subset with the most representative set of variables. Furthermore, we developed a procedure for treating control, fixed, free and interaction terms simultaneously in the residual weight analysis. The interactions are residualized properly against their main effects to maintain their true effects in the model. We tested this method using two simulated examples.


title: Elements of prime order in Tate-Shafarevich groups of abelian varieties over $\mathbb{Q}$

abstract: For each prime $p$, we show that there exist geometrically simple abelian varieties $A/\mathbb Q$ with non-trivial $p$-torsion in their Tate-Shafarevich groups. Specifically, for any prime $N\equiv 1 \pmod{p}$, let $A_f$ be an optimal quotient of $J_0(N)$ with a rational point $P$ of order $p$, and let $B = A_f/\langle P \rangle$. Then the number of positive integers $d \leq X$, such that the Tate-Shafarevich group of $\hat B_d$ has non-trivial $p$-torsion, is $\gg X/\log X$, where $\hat B_d$ is the dual of the $d$-th quadratic twist of $B$. We prove this more generally for abelian varieties of $\mathrm{GL}_2$-type with a $p$-isogeny satisfying a mild technical condition. In the special case of elliptic curves, we give stronger results, including many examples where $\mathrm{Sha}(E_d)[p] \neq 0$ for an explicit positive proportion of integers $d$.


title: Active liquid crystals powered by force-sensing DNA-motor clusters

abstract: Cytoskeletal active nematics exhibit striking non-equilibrium dynamics that are powered by energy-consuming molecular motors. To gain insight into the structure and mechanics of these materials, we design programmable clusters in which kinesin motors are linked by a double-stranded DNA linker. The efficiency by which DNA-based clusters power active nematics depends on both the stepping dynamics of the kinesin motors and the chemical structure of the polymeric linker. Fluorescence anisotropy measurements reveal that the motor clusters, like filamentous microtubules, exhibit local nematic order. The properties of the DNA linker enable the design of force-sensing clusters. When the load across the linker exceeds a critical threshold the clusters fall apart, ceasing to generate active stresses and slowing the system dynamics. Fluorescence readout reveals the fraction of bound clusters that generate interfilament sliding. In turn, this yields the average load experienced by the kinesin motors as they step along the microtubules. DNA-motor clusters provide a foundation for understanding the molecular mechanism by which nanoscale molecular motors collectively generate mesoscopic active stresses, which in turn power macroscale non-equilibrium dynamics of active nematics.


title: On the Michor-Mumford phenomenon in the infinite dimensional Heisenberg group

abstract: In the infinite dimensional Heisenberg group, we construct a left invariant weak Riemannian metric that gives a degenerate geodesic distance. The same construction yields a degenerate sub-Riemannian distance. We show how the standard notion of sectional curvature adapts to our framework, but it cannot be defined everywhere and it is unbounded on suitable sequences of planes. The vanishing of the distance precisely occurs along this sequence of planes, so that the degenerate Riemannian distance appears in connection with an unbounded sectional curvature. In the 2005 paper by Michor and Mumford, this phenomenon was first observed in some specific Fr\'echet manifolds.


title: High-brilliance ultra-narrow-band x-rays via electron radiation in colliding laser pulses

abstract: A setup of a unique x-ray source is put forward employing a relativistic electron beam interacting with two counter-propagating laser pulses in the nonlinear few-photon regime. In contrast to Compton scattering sources, the envisaged x-ray source exhibits an extremely narrow relative bandwidth of the order of $10^{-4}$, comparable with an x-ray free-electron laser (XFEL). The brilliance of the x-rays can be an order of magnitude higher than that of a state-of-the-art Compton source. By tuning the laser intensities and the electron energy, one can realize either a single peak or a comb-like x-ray source of around keV energy. The laser intensity and the electron energy in the suggested setup are rather moderate, rendering this scheme compact and table-top size, as opposed to XFEL and synchrotron infrastructures.


title: Implementation and Evaluation of Data Center Congestion Controller with Switch Assistance

abstract: In this work, we provide the design and implementation of a switch-assisted congestion control algorithm for data center networks (DCNs). In particular, we provide a prototype of the switch-driven congestion control algorithm and deploy it in a real data center. The prototype is based on few simple modifications to the switch software. The modifications imposed by the algorithm on the switch are to enable the switch to modify the TCP receive-window field in the packet headers. By doing so, the algorithm can enforce a pre-calculated (or target rate) to limit the sending rate at the sources. Therefore, the algorithm requires no modifications to the TCP source or receiver code which considered out of the DCN operators' control (e.g., in the public cloud where the VM is maintained by the tenant). This paper describes in detail two implementations, one as a Linux kernel module and the second as an added feature to the well-known software switch, Open vSwitch. Then we present evaluation results based on experiments of the deployment of both designs in a small testbed to demonstrate the effectiveness of the proposed technique in achieving high throughput, good fairness, and short flow completion times for delay-sensitive flows.


title: Real-time 3D Object Detection using Feature Map Flow

abstract: In this paper, we present a real-time 3D detection approach considering time-spatial feature map aggregation from different time steps of deep neural model inference (named feature map flow, FMF). Proposed approach improves the quality of 3D detection center-based baseline and provides real-time performance on the nuScenes and Waymo benchmark. Code is available at https://github.com/YoushaaMurhij/FMFNet


title: Image Classification with CondenseNeXt for ARM-Based Computing Platforms

abstract: In this paper, we demonstrate the implementation of our ultra-efficient deep convolutional neural network architecture: CondenseNeXt on NXP BlueBox, an autonomous driving development platform developed for self-driving vehicles. We show that CondenseNeXt is remarkably efficient in terms of FLOPs, designed for ARM-based embedded computing platforms with limited computational resources and can perform image classification without the need of a CUDA enabled GPU. CondenseNeXt utilizes the state-of-the-art depthwise separable convolution and model compression techniques to achieve a remarkable computational efficiency. Extensive analyses are conducted on CIFAR-10, CIFAR-100 and ImageNet datasets to verify the performance of CondenseNeXt Convolutional Neural Network (CNN) architecture. It achieves state-of-the-art image classification performance on three benchmark datasets including CIFAR-10 (4.79% top-1 error), CIFAR-100 (21.98% top-1 error) and ImageNet (7.91% single model, single crop top-5 error). CondenseNeXt achieves final trained model size improvement of 2.9+ MB and up to 59.98% reduction in forward FLOPs compared to CondenseNet and can perform image classification on ARM-Based computing platforms without needing a CUDA enabled GPU support, with outstanding efficiency.


title: PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEs

abstract: Partial differential equations (PDEs) play a fundamental role in modeling and simulating problems across a wide range of disciplines. Recent advances in deep learning have shown the great potential of physics-informed neural networks (PINNs) to solve PDEs as a basis for data-driven modeling and inverse analysis. However, the majority of existing PINN methods, based on fully-connected NNs, pose intrinsic limitations to low-dimensional spatiotemporal parameterizations. Moreover, since the initial/boundary conditions (I/BCs) are softly imposed via penalty, the solution quality heavily relies on hyperparameter tuning. To this end, we propose the novel physics-informed convolutional-recurrent learning architectures (PhyCRNet and PhyCRNet-s) for solving PDEs without any labeled data. Specifically, an encoder-decoder convolutional long short-term memory network is proposed for low-dimensional spatial feature extraction and temporal evolution learning. The loss function is defined as the aggregated discretized PDE residuals, while the I/BCs are hard-encoded in the network to ensure forcible satisfaction (e.g., periodic boundary padding). The networks are further enhanced by autoregressive and residual connections that explicitly simulate time marching. The performance of our proposed methods has been assessed by solving three nonlinear PDEs (e.g., 2D Burgers' equations, the $\lambda$-$\omega$ and FitzHugh Nagumo reaction-diffusion equations), and compared against the start-of-the-art baseline algorithms. The numerical results demonstrate the superiority of our proposed methodology in the context of solution accuracy, extrapolability and generalizability.


title: Can An Image Classifier Suffice For Action Recognition?

abstract: We explore a new perspective on video understanding by casting the video recognition problem as an image recognition task. Our approach rearranges input video frames into super images, which allow for training an image classifier directly to fulfill the task of action recognition, in exactly the same way as image classification. With such a simple idea, we show that transformer-based image classifiers alone can suffice for action recognition. In particular, our approach demonstrates strong and promising performance against SOTA methods on several public datasets including Kinetics400, Moments In Time, Something-Something V2 (SSV2), Jester and Diving48. We also experiment with the prevalent ResNet image classifiers in computer vision to further validate our idea. The results on both Kinetics400 and SSV2 are comparable to some of the best-performed CNN approaches based on spatio-temporal modeling. Our source codes and models are available at https://github.com/IBM/sifar-pytorch.


title: Electronic and magnetic properties of iridium ilmenites $A$IrO$_3$ ($A=$ Mg, Zn, and Mn)

abstract: We theoretically investigate the electronic band structures and magnetic properties of ilmenites with edge-sharing IrO$_6$ honeycomb layers, $A$IrO$_3$ with $A=$ Mg, Zn, and Mn, in comparison with a collinear antiferromagnet MnTiO$_3$. The compounds with $A=$ Mg and Zn were recently reported in Y.~Haraguchi {\it et al.}, Phys. Rev. Materials {\bf 2}, 054411 (2018), while MnIrO$_3$ has not been synthesized yet but the honeycomb stacking structure was elaborated in a superlattice with MnTiO$_3$ in K.~Miura {\it et al.}, Commun. Mater. {\bf 1}, 55 (2020). We find that, in contrast to MnTiO$_3$, where an energy gap opens in the Ti $3d$ bands by antiferromagnetic ordering of the high-spin $S=5/2$ moments, MgIrO$_3$ and ZnIrO$_3$ have a gap in the Ir $5d$ bands under the influence of both spin-orbit coupling and electron correlation. Their electronic structures are similar to those in the spin-orbit coupled Mott insulators with the $j_{\rm eff}=1/2$ pseudospin degree of freedom, as found in monoclinic $A_2$IrO$_3$ with $A=$ Na and Li which have been studied as candidates for the Kitaev spin liquid. Indeed, we find that the effective exchange interactions between the $j_{\rm eff}=1/2$ pseudospins are dominated by the Kitaev-type bond-dependent interaction and the symmetric off-diagonal interactions. On the other hand, for MnIrO$_3$, we show that the local lattice structure is largely deformed, and both Mn $3d$ and Ir $5d$ bands appear near the Fermi level in a complicated manner, which makes the electronic and magnetic properties qualitatively different from MgIrO$_3$ and ZnIrO$_3$. Our results indicate that the IrO$_6$ honeycomb network in the ilmenites $A$IrO$_3$ with $A=$ Mg and Zn would offer a good platform for exotic magnetism by the spin-orbital entangled moments like the Kitaev spin liquid.


title: On the fifth Whitney cone of a complex analytic curve

abstract: From a procedure to calculate the $C_5$-cone of a reduced complex analytic curve $X \subset \mathbb{C}^n$ at a singular point $0 \in X$, we extract a collection of integers that we call {\it auxiliary multiplicities} and we prove they characterize the Lipschitz type of complex curve singularities. We then use them to improve the known bounds for the number of irreducible components of the $C_5$-cone. We finish by giving an example showing that in a Lipschitz equisingular family of curves the number of planes in the $C_5$-cone may not be constant.


title: Uniform error bounds of exponential wave integrator methods for the long-time dynamics of the Dirac equation with small potentials

abstract: Two exponential wave integrator Fourier pseudospectral (EWI-FP) methods are presented and analyzed for the long-time dynamics of the Dirac equation with small potentials characterized by $\varepsilon \in (0, 1]$ a dimensionless parameter. Based on the (symmetric) exponential wave integrator for temporal derivatives in phase space followed by applying the Fourier pseudospectral discretization for spatial derivatives, the EWI-FP methods are explicit and of spectral accuracy in space and second-order accuracy in time for any fixed $\varepsilon = \varepsilon_0$. Uniform error bounds are rigorously carried out at $O(h^{m_0}+\tau^2)$ up to the time at $O(1/\varepsilon)$ with the mesh size $h$, time step $\tau$ and $m_0$ an integer depending on the regularity of the solution. Extensive numerical results are reported to confirm our error bounds and comparisons of two methods are shown. Finally, dynamics of the Dirac equation in 2D are presented to validate the numerical schemes.


title: Inferring a Continuous Distribution of Atom Coordinates from Cryo-EM Images using VAEs

abstract: Cryo-electron microscopy (cryo-EM) has revolutionized experimental protein structure determination. Despite advances in high resolution reconstruction, a majority of cryo-EM experiments provide either a single state of the studied macromolecule, or a relatively small number of its conformations. This reduces the effectiveness of the technique for proteins with flexible regions, which are known to play a key role in protein function. Recent methods for capturing conformational heterogeneity in cryo-EM data model it in volume space, making recovery of continuous atomic structures challenging. Here we present a fully deep-learning-based approach using variational auto-encoders (VAEs) to recover a continuous distribution of atomic protein structures and poses directly from picked particle images and demonstrate its efficacy on realistic simulated data. We hope that methods built on this work will allow incorporation of stronger prior information about protein structure and enable better understanding of non-rigid protein structures.


title: Parmsurv: a SAS Macro for Flexible Parametric Survival Analysis with Long-Term Predictions

abstract: Health economic evaluations often require predictions of survival rates beyond the follow-up period. Parametric survival models can be more convenient for economic modelling than the Cox model. The generalized gamma (GG) and generalized F (GF) distributions are extensive families that contain almost all commonly used distributions with various hazard shapes and arbitrary complexity. In this study, we present a new SAS macro for implementing a wide variety of flexible parametric models including the GG and GF distributions and their special cases, as well as the Gompertz distribution. Proper custom distributions are also supported. Different from existing SAS procedures, this macro not only supports regression on the location parameter but also on ancillary parameters, which greatly increases model flexibility. In addition, the SAS macro supports weighted regression, stratified regression and robust inference. This study demonstrates with several examples how the SAS macro can be used for flexible survival modeling and extrapolation.


title: Stochastic Parameterization using Compressed Sensing: Application to the Lorenz-96 Atmospheric Model

abstract: Growing set of optimization and regression techniques, based upon sparse representations of signals, to build models from data sets has received widespread attention recently with the advent of compressed sensing. This paper deals with the parameterization of the Lorenz-96 model with two time-scales that mimics mid-latitude atmospheric dynamics with microscopic convective processes. Compressed sensing is used to build models (vector fields) to emulate the behavior of the fine-scale process, so that explicit simulations become an online benchmark for parameterization. We apply compressed sensing, where the sparse recovery is achieved by constructing a sensing/dictionary matrix from ergodic samples generated by the Lorenz-96 atmospheric model, to parameterize the unresolved variables in terms of resolved variables. Stochastic parameterization is achieved by auto-regressive modelling of noise. We utilize the ensemble Kalman filter for data assimilation, where observations (direct measurements) are assimilated in the low-dimensional stochastic parameterized model to provide predictions. Finally, we compare the predictions of compressed sensing and Wilk's polynomial regression to demonstrate the potential effectiveness of the proposed methodology.


title: Mentorship Network Structure: How Relationships Emerge Online and What They Mean for Amateur Creators

abstract: Relationships form the core of connected learning. In this study, we apply and extend social network analysis methods to uncover the layered network structure of relationships among Fanfiction.net authors and reviewers. Fanfiction.net, one of the world's largest fanfiction communities, is a space where millions of young people engage with written media, connect over shared interests, and receive support and mentoring from a distributed audience. Does an affinity space such as Fanfiction.net have the same structure as social networks Facebook and Twitter? We applied k-means clustering on millions of relationships to determine that Fanfiction.net has 2 to 3 layers, in contrast with the 4-layer structure of Facebook and 5-layer structure of Twitter. In addition, we conducted a large-scale machine classification of Fanfiction.net reviews to reveal the types of mentoring exchanged in each layer. Our findings show that the relationships where reviews are exchanged most frequently are most likely to contain substantive reviews. We discuss implications of these findings for the theory of distributed mentoring as well as the design of online affinity networks.


title: Time-Series Representation Learning via Temporal and Contextual Contrasting

abstract: Learning decent representations from unlabeled time-series data with temporal dynamics is a very challenging task. In this paper, we propose an unsupervised Time-Series representation learning framework via Temporal and Contextual Contrasting (TS-TCC), to learn time-series representation from unlabeled data. First, the raw time-series data are transformed into two different yet correlated views by using weak and strong augmentations. Second, we propose a novel temporal contrasting module to learn robust temporal representations by designing a tough cross-view prediction task. Last, to further learn discriminative representations, we propose a contextual contrasting module built upon the contexts from the temporal contrasting module. It attempts to maximize the similarity among different contexts of the same sample while minimizing similarity among contexts of different samples. Experiments have been carried out on three real-world time-series datasets. The results manifest that training a linear classifier on top of the features learned by our proposed TS-TCC performs comparably with the supervised training. Additionally, our proposed TS-TCC shows high efficiency in few-labeled data and transfer learning scenarios. The code is publicly available at https://github.com/emadeldeen24/TS-TCC.


title: Online Cognitive Data Sensing and Processing Optimization in Energy-harvesting Edge Computing Systems

abstract: Mobile edge computing (MEC) has recently become a prevailing technique to alleviate the intensive computation burden in Internet of Things (IoT) networks. However, the limited device battery capacity and stringent spectrum resource significantly restrict the data processing performance of MEC-enabled IoT networks. To address the two performance limitations, we consider in this paper an MEC-enabled IoT system with an energy harvesting (EH) wireless device (WD) which opportunistically accesses the licensed spectrum of an overlaid primary communication link for task offloading. We aim to maximize the long-term average sensing rate of the WD subject to quality of service (QoS) requirement of primary link, average power constraint of MEC server (MS) and data queue stability of both MS and WD. We formulate the problem as a multi-stage stochastic optimization and propose an online algorithm named PLySE that applies the perturbed Lyapunov optimization technique to decompose the original problem into per-slot deterministic optimization problems. For each per-slot problem, we derive the closed-form optimal solution of data sensing and processing control to facilitate low-complexity real-time implementation. Interestingly, our analysis finds that the optimal solution exhibits an threshold-based structure. Simulation results collaborate with our analysis and demonstrate more than 46.7\% data sensing rate improvement of the proposed PLySE over representative benchmark methods.


title: Aldosterone and Dexamethasone Activate African Lungfish Mineralocorticoid Receptor: Increased Activation After Removal of the Amino-Terminal Domain

abstract: Aldosterone, the main physiological mineralocorticoid in humans and other terrestrial vertebrates, first appears in lungfish, which are lobe-finned fish that are forerunners of terrestrial vertebrates. Aldosterone activation of the MR regulates internal homeostasis of water, sodium and potassium, which was critical in the conquest of land by vertebrates. We studied transcriptional activation of the slender African lungfish MR by aldosterone, other corticosteroids and progesterone and find that aldosterone, 11-deoxycorticosterone, 11-deoxycortisol and progesterone have half-maximal responses (EC50s) below 1 nM and are potential physiological mineralocorticoids. In contrast, EC50s for corticosterone and cortisol were 23 nM and 66 nM, respectively. Unexpectedly, truncated lungfish MR, consisting of the DNA-binding, hinge and steroid-binding domains, had a stronger response to corticosteroids and progesterone than full-length lungfish MR, indicating that the N-terminal domain represses steroid activation of lungfish MR, unlike human MR in which the N-terminal domain contains an activation function. BLAST searches of GenBank did not retrieve a GR ortholog, leading us to test dexamethasone and triamcinolone for activation of lungfish MR. At 10 nM, both synthetic glucocorticoids are about 4-fold stronger than 10 nM aldosterone in activating full-length lungfish MR, leading us to propose that lungfish MR also functions as a GR.


title: Dark solitons in a trapped gas of long-range interacting bosons

abstract: We consider the interplay of repulsive short-range and same-sign long-range interactions in the dynamics of dark solitons, as prototypical coherent nonlinear excitations in a trapped 1D Bose gas. First, the form of the ground state is examined, and then both the existence of the solitary waves and their stability properties are explored, and corroborated by direct numerical simulations. We find that single- and multiple-dark-soliton states can exist and are generically robust in the presence of long-range interactions. We analyze the modes of vibration of such excitations and find that their respective frequencies are significantly upshifted as the strength of the long-range interactions is increased. Indeed, we find that a prefactor of the long-range interactions considered comparable to the trap strength may upshift the dark soliton oscillation frequency by {\it an order of magnitude}, in comparison to the well established one of $\Omega/\sqrt{2}$ in a trap of frequency $\Omega$.


title: Generalized max-flows and min-cuts in simplicial complexes

abstract: We consider high dimensional variants of the maximum flow and minimum cut problems in the setting of simplicial complexes and provide both algorithmic and hardness results. By viewing flows and cuts topologically in terms of the simplicial (co)boundary operator we can state these problems as linear programs and show that they are dual to one another. Unlike graphs, complexes with integral capacity constraints may have fractional max-flows. We show that computing a maximum integral flow is NP-hard. Moreover, we give a combinatorial definition of a simplicial cut that seems more natural in the context of optimization problems and show that computing such a cut is NP-hard. However, we provide conditions on the simplicial complex for when the cut found by the linear program is a combinatorial cut. For $d$-dimensional simplicial complexes embedded into $\mathbb{R}^{d+1}$ we provide algorithms operating on the dual graph: computing a maximum flow is dual to computing a shortest path and computing a minimum cut is dual to computing a minimum cost circulation. Finally, we investigate the Ford-Fulkerson algorithm on simplicial complexes, prove its correctness, and provide a heuristic which guarantees it to halt.


title: Graph Convolutional Memory using Topological Priors

abstract: Solving partially-observable Markov decision processes (POMDPs) is critical when applying reinforcement learning to real-world problems, where agents have an incomplete view of the world. We present graph convolutional memory (GCM), the first hybrid memory model for solving POMDPs using reinforcement learning. GCM uses either human-defined or data-driven topological priors to form graph neighborhoods, combining them into a larger network topology using dynamic programming. We query the graph using graph convolution, coalescing relevant memories into a context-dependent belief. When used without human priors, GCM performs similarly to state-of-the-art methods. When used with human priors, GCM outperforms these methods on control, memorization, and navigation tasks while using significantly fewer parameters.


title: Hear Me Out: Fusional Approaches for Audio Augmented Temporal Action Localization

abstract: State of the art architectures for untrimmed video Temporal Action Localization (TAL) have only considered RGB and Flow modalities, leaving the information-rich audio modality totally unexploited. Audio fusion has been explored for the related but arguably easier problem of trimmed (clip-level) action recognition. However, TAL poses a unique set of challenges. In this paper, we propose simple but effective fusion-based approaches for TAL. To the best of our knowledge, our work is the first to jointly consider audio and video modalities for supervised TAL. We experimentally show that our schemes consistently improve performance for state of the art video-only TAL approaches. Specifically, they help achieve new state of the art performance on large-scale benchmark datasets - ActivityNet-1.3 (54.34 mAP@0.5) and THUMOS14 (57.18 mAP@0.5). Our experiments include ablations involving multiple fusion schemes, modality combinations and TAL architectures. Our code, models and associated data are available at https://github.com/skelemoa/tal-hmo.


title: Ladder operators and coherent states for the Rosen-Morse system and its rational extensions

abstract: Ladder operators for the hyperbolic Rosen-Morse (RMII) potential are realized using the shape invariance property appearing, in particular, using supersymmetric quantum mechanics. The extension of the ladder operators to a specific class of rational extensions of the RMII potential is presented and discussed. Coherent states are then constructed as almost eigenstates of the lowering operators. Some properties are analyzed and compared. The ladder operators and coherent states constructions presented are extended to the case of the trigonometric Rosen-Morse (RMI) potential using a point canonical transformation.


title: On a novel training algorithm for sequence-to-sequence predictive recurrent networks

abstract: Neural networks mapping sequences to sequences (seq2seq) lead to significant progress in machine translation and speech recognition. Their traditional architecture includes two recurrent networks (RNs) followed by a linear predictor. In this manuscript we perform analysis of a corresponding algorithm and show that the parameters of the RNs of the well trained predictive network are not independent of each other. Their dependence can be used to significantly improve the network effectiveness. The traditional seq2seq algorithms require short term memory of a size proportional to the predicted sequence length. This requirement is quite difficult to implement in a neuroscience context. We present a novel memoryless algorithm for seq2seq predictive networks and compare it to the traditional one in the context of time series prediction. We show that the new algorithm is more robust and makes predictions with higher accuracy than the traditional one.


title: On duoidal $\infty$-categories

abstract: A duoidal category is a category equipped with two monoidal structures in which one is (op)lax monoidal with respect to the other. In this paper we introduce duoidal $\infty$-categories which are counterparts of duoidal categories in the setting of $\infty$-categories. There are three kinds of functors between duoidal $\infty$-categories, which are called bilax, double lax, and double oplax monoidal functors. We make three formulations of $\infty$-categories of duoidal $\infty$-categories according to which functors we take. Furthermore, corresponding to the three kinds of functors, we define bimonoids, double monoids, and double comonoids in duoidal $\infty$-categories.


title: Score-Based Change Detection for Gradient-Based Learning Machines

abstract: The widespread use of machine learning algorithms calls for automatic change detection algorithms to monitor their behavior over time. As a machine learning algorithm learns from a continuous, possibly evolving, stream of data, it is desirable and often critical to supplement it with a companion change detection algorithm to facilitate its monitoring and control. We present a generic score-based change detection method that can detect a change in any number of components of a machine learning model trained via empirical risk minimization. This proposed statistical hypothesis test can be readily implemented for such models designed within a differentiable programming framework. We establish the consistency of the hypothesis test and show how to calibrate it to achieve a prescribed false alarm rate. We illustrate the versatility of the approach on synthetic and real data.


title: Hidden-bottom hadronic decays of $\Upsilon(10753)$ with a $\eta^{(\prime)}$ or $\omega$ emission

abstract: In this work, we propose the $4S$-$3D$ mixing scheme to assign the $\Upsilon(10753)$ into the conventional bottomonium family. Under this interpretation, we further study its hidden-bottom hadronic decays with a $\eta^{(\prime)}$ or $\omega$ emission, which include $\Upsilon(10753)\to\Upsilon(1S)\eta^{(\prime)}$, $\Upsilon(10753)\to h_{b}(1P)\eta$ and $\Upsilon(10753)\to\chi_{bJ}\omega$ ($J$=0,1,2) processes. Since the $\Upsilon(10753)$ is above the $B\bar{B}$ threshold, the coupled-channel effect cannot be ignored, thus, when calculating partial decay widths of these $\Upsilon(10753)$ hidden-bottom decays, we apply the hadronic loop mechanism. Our result shows that these discussed decay processes own considerable branching fractions with the order of magnitude of $10^{-4}\sim 10^{-3}$, which can be accessible at Belle II and other future experiments.


title: Attention-guided Progressive Mapping for Profile Face Recognition

abstract: The past few years have witnessed great progress in the domain of face recognition thanks to advances in deep learning. However, cross pose face recognition remains a significant challenge. It is difficult for many deep learning algorithms to narrow the performance gap caused by pose variations; the main reasons for this relate to the intra-class discrepancy between face images in different poses and the pose imbalances of training datasets. Learning pose-robust features by traversing to the feature space of frontal faces provides an effective and cheap way to alleviate this problem. In this paper, we present a method for progressively transforming profile face representations to the canonical pose with an attentive pair-wise loss. Firstly, to reduce the difficulty of directly transforming the profile face features into a frontal pose, we propose to learn the feature residual between the source pose and its nearby pose in a block-byblock fashion, and thus traversing to the feature space of a smaller pose by adding the learned residual. Secondly, we propose an attentive pair-wise loss to guide the feature transformation progressing in the most effective direction. Finally, our proposed progressive module and attentive pair-wise loss are light-weight and easy to implement, adding only about 7:5% extra parameters. Evaluations on the CFP and CPLFW datasets demonstrate the superiority of our proposed method. Code is available at https://github.com/hjy1312/AGPM.


title: Classical spin dynamics based on SU($N$) coherent states

abstract: We introduce a classical limit of the dynamics of quantum spin systems based on coherent states of SU($N$), where $N$ is the dimension of the local Hilbert space. This approach, that generalizes the well-known Landau-Lifshitz dynamics from SU(2) to SU($N$), provides a better approximation to the exact quantum dynamics for a large class of realistic spin Hamiltonians, including $S \geq 1$ systems with large single-ion anisotropy and weakly-coupled multi-spin units, such as dimers or trimers. We illustrate this idea by comparing the spin structure factors of a single-ion $S=1$ model that are obtained with the SU(2) and SU(3) classical spin dynamics against the exact solution.


title: AdaptCL: Efficient Collaborative Learning with Dynamic and Adaptive Pruning

abstract: In multi-party collaborative learning, the parameter server sends a global model to each data holder for local training and then aggregates committed models globally to achieve privacy protection. However, both the dragger issue of synchronous collaborative learning and the staleness issue of asynchronous collaborative learning make collaborative learning inefficient in real-world heterogeneous environments. We propose a novel and efficient collaborative learning framework named AdaptCL, which generates an adaptive sub-model dynamically from the global base model for each data holder, without any prior information about worker capability. All workers (data holders) achieve approximately identical update time as the fastest worker by equipping them with capability-adapted pruned models. Thus the training process can be dramatically accelerated. Besides, we tailor the efficient pruned rate learning algorithm and pruning approach for AdaptCL. Meanwhile, AdaptCL provides a mechanism for handling the trade-off between accuracy and time overhead and can be combined with other techniques to accelerate training further. Empirical results show that AdaptCL introduces little computing and communication overhead. AdaptCL achieves time savings of more than 41\% on average and improves accuracy in a low heterogeneous environment. In a highly heterogeneous environment, AdaptCL achieves a training speedup of 6.2x with a slight loss of accuracy.


title: Visual Conceptual Blending with Large-scale Language and Vision Models

abstract: We ask the question: to what extent can recent large-scale language and image generation models blend visual concepts? Given an arbitrary object, we identify a relevant object and generate a single-sentence description of the blend of the two using a language model. We then generate a visual depiction of the blend using a text-based image generation model. Quantitative and qualitative evaluations demonstrate the superiority of language models over classical methods for conceptual blending, and of recent large-scale image generation models over prior models for the visual depiction.


title: Quantized Nonlinear Thouless Pumping

abstract: The sharply quantized transport observed in the integer quantum Hall effect can be explained via a simple one-dimensional model with a time-periodic, adiabatically varying potential in which electronic charge is pumped from one side of the system to the other. This so-called `Thouless pump' captures the topological physics of the quantum Hall effect using the notion of dimensional reduction: The time-varying potential mathematically maps onto a momentum coordinate in a conceptual second dimension. Importantly, this assumes an electronic system in equilibrium and in its ground state, that is, with uniformly filled bands below a Fermi energy. Here, we theoretically propose and experimentally demonstrate quantized nonlinear Thouless pumping of photons with a band that is decidedly not uniformly occupied. In our system, nonlinearity acts to quantize transport via soliton formation and spontaneous symmetry breaking bifurcations. Quantization follows from the fact that the instantaneous soliton solutions centered upon a given unit cell are identical after each pump cycle, up to translation invariance; this is an entirely different mechanism from traditional Thouless pumping of fermions in equilibrium. Our result shows that nonlinearity and interparticle interactions can induce quantized transport and topological behavior even where the linear limit does not.

categories: physics.optics cond-mat.mes-hall cond-mat.other cond-mat.quant-gas quant-ph


title: The first-order definability of generic large cardinals

abstract: We show that the notions of generic and Laver-generic supercompactness are first-order definable in the language of ZFC. This also holds for generic and Laver-generic (almost) hugeness as well as for generic versions of other large cardinals.


title: Continuous Control with Deep Reinforcement Learning for Autonomous Vessels

abstract: Maritime autonomous transportation has played a crucial role in the globalization of the world economy. Deep Reinforcement Learning (DRL) has been applied to automatic path planning to simulate vessel collision avoidance situations in open seas. End-to-end approaches that learn complex mappings directly from the input have poor generalization to reach the targets in different environments. In this work, we present a new strategy called state-action rotation to improve agent's performance in unseen situations by rotating the obtained experience (state-action-state) and preserving them in the replay buffer. We designed our model based on Deep Deterministic Policy Gradient, local view maker, and planner. Our agent uses two deep Convolutional Neural Networks to estimate the policy and action-value functions. The proposed model was exhaustively trained and tested in maritime scenarios with real maps from cities such as Montreal and Halifax. Experimental results show that the state-action rotation on top of the CVN consistently improves the rate of arrival to a destination (RATD) by up 11.96% with respect to the Vessel Navigator with Planner and Local View (VNPLV), as well as it achieves superior performance in unseen mappings by up 30.82%. Our proposed approach exhibits advantages in terms of robustness when tested in a new environment, supporting the idea that generalization can be achieved by using state-action rotation.


title: SymbolicGPT: A Generative Transformer Model for Symbolic Regression

abstract: Symbolic regression is the task of identifying a mathematical expression that best fits a provided dataset of input and output values. Due to the richness of the space of mathematical expressions, symbolic regression is generally a challenging problem. While conventional approaches based on genetic evolution algorithms have been used for decades, deep learning-based methods are relatively new and an active research area. In this work, we present SymbolicGPT, a novel transformer-based language model for symbolic regression. This model exploits the advantages of probabilistic language models like GPT, including strength in performance and flexibility. Through comprehensive experiments, we show that our model performs strongly compared to competing models with respect to the accuracy, running time, and data efficiency.


title: Robust Pose Transfer with Dynamic Details using Neural Video Rendering

abstract: Pose transfer of human videos aims to generate a high fidelity video of a target person imitating actions of a source person. A few studies have made great progress either through image translation with deep latent features or neural rendering with explicit 3D features. However, both of them rely on large amounts of training data to generate realistic results, and the performance degrades on more accessible internet videos due to insufficient training frames. In this paper, we demonstrate that the dynamic details can be preserved even trained from short monocular videos. Overall, we propose a neural video rendering framework coupled with an image-translation-based dynamic details generation network (D2G-Net), which fully utilizes both the stability of explicit 3D features and the capacity of learning components. To be specific, a novel texture representation is presented to encode both the static and pose-varying appearance characteristics, which is then mapped to the image space and rendered as a detail-rich frame in the neural rendering stage. Moreover, we introduce a concise temporal loss in the training stage to suppress the detail flickering that is made more visible due to high-quality dynamic details generated by our method. Through extensive comparisons, we demonstrate that our neural human video renderer is capable of achieving both clearer dynamic details and more robust performance even on accessible short videos with only 2k - 4k frames.


title: Semi-supervised Semantic Segmentation with Directional Context-aware Consistency

abstract: Semantic segmentation has made tremendous progress in recent years. However, satisfying performance highly depends on a large number of pixel-level annotations. Therefore, in this paper, we focus on the semi-supervised segmentation problem where only a small set of labeled data is provided with a much larger collection of totally unlabeled images. Nevertheless, due to the limited annotations, models may overly rely on the contexts available in the training data, which causes poor generalization to the scenes unseen before. A preferred high-level representation should capture the contextual information while not losing self-awareness. Therefore, we propose to maintain the context-aware consistency between features of the same identity but with different contexts, making the representations robust to the varying environments. Moreover, we present the Directional Contrastive Loss (DC Loss) to accomplish the consistency in a pixel-to-pixel manner, only requiring the feature with lower quality to be aligned towards its counterpart. In addition, to avoid the false-negative samples and filter the uncertain positive samples, we put forward two sampling strategies. Extensive experiments show that our simple yet effective method surpasses current state-of-the-art methods by a large margin and also generalizes well with extra image-level annotations.


title: Scalar dark matter and Muon $g-2$ in a $U(1)_{L_{\mu}-L_{\tau}}$ model

abstract: We consider a simple scalar dark matter model within the frame of gauged $L_{\mu}-L_{\tau}$ symmetry. A gauge boson $Z'$ as well as two scalar fields $S$ and $\Phi$ are introduced to the Standard Model (SM). $S$ and $\Phi$ are SM singlet but both with $U(1)_{L_{\mu}-L_{\tau}}$ charge. The real component and imaginary component of $S$ can acquire different masses after spontaneously symmetry breaking, and the lighter one can play the role of dark matter which is stabilized by the residual $Z_2$ symmetry. A viable parameter space is considered to discuss the possibility of light dark matter as well as co-annihilation case, and we present current $(g-2)_{\mu}$ anomaly, Higgs invisible decay, dark matter relic density as well as direct detection constriants on the parameter space.


title: $\infty$-cosheafification

abstract: Cosheaves are a dual notion of sheaves. In this paper, we prove existence of a dual of sheafifications, called \textit{cosheafifications}, in the $\infty$-category theory. We also prove that the $\infty$-category of $\infty$-cosheaves is presentable and equivalent to an $\infty$-category of left adjoint functors.


title: Listen As You Wish: Audio based Event Detection via Text-to-Audio Grounding in Smart Cities

abstract: With the development of internet of things technologies, tremendous sensor audio data has been produced, which poses great challenges to audio-based event detection in smart cities. In this paper, we target a challenging audio-based event detection task, namely, text-to-audio grounding. In addition to precisely localizing all of the desired on- and off-sets in the untrimmed audio, this challenging new task requires extensive acoustic and linguistic comprehension as well as the reasoning for the crossmodal matching relations between the audio and query. The current approaches often treat the query as an entire one through a global query representation in order to address those issues. We contend that this strategy has several drawbacks. Firstly, the interactions between the query and the audio are not fully utilized. Secondly, it has not distinguished the importance of different keywords in a query. In addition, since the audio clips are of arbitrary lengths, there exist many segments which are irrelevant to the query but have not been filtered out in the approach. This further hinders the effective grounding of desired segments. Motivated by the above concerns, a novel Cross-modal Graph Interaction (CGI) model is proposed to comprehensively model the relations between the words in a query through a novel language graph. To capture the fine-grained relevances between the audio and query, a cross-modal attention module is introduced to generate snippet-specific query representations and automatically assign higher weights to keywords with more important semantics. Furthermore, we develop a cross-gating module for the audio and query to weaken irrelevant parts and emphasize the important ones.


title: Building a Video-and-Language Dataset with Human Actions for Multimodal Logical Inference

abstract: This paper introduces a new video-and-language dataset with human actions for multimodal logical inference, which focuses on intentional and aspectual expressions that describe dynamic human actions. The dataset consists of 200 videos, 5,554 action labels, and 1,942 action triplets of the form <subject, predicate, object> that can be translated into logical semantic representations. The dataset is expected to be useful for evaluating multimodal inference systems between videos and semantically complicated sentences including negation and quantification.


title: OCCAM: Optimal Data Reuse for Convolutional Neural Networks

abstract: Convolutional neural networks (CNNs) are emerging as powerful tools for image processing in important commercial applications. We focus on the important problem of improving the latency of image recognition. CNNs' large data at each layer's input, filters, and output poses a memory bandwidth problem. While previous work captures only some of the enormous data reuse, full reuse implies that the initial input image and filters are read once from off chip and the final output is written once off chip without spilling the intermediate layers' data to off-chip. We propose Occam to capture full reuse via four contributions. (1) We identify the necessary condition for full reuse. (2) We identify the dependence closure as the sufficient condition to capture full reuse using the least on-chip memory. (3) Because the dependence closure is often too large to fit in on-chip memory, we propose a dynamic programming algorithm that optimally partitions a given CNN to guarantee the least off-chip traffic at the partition boundaries for a given on-chip capacity. Occam's partitions reside on different chips forming a pipeline so that a partition's filters and dependence closure remain on-chip as different images pass through (i.e., each partition incurs off-chip traffic only for its inputs and outputs). (4) because the optimal partitions may result in an unbalanced pipeline, we propose staggered asynchronous pipelines (STAP) which replicates the bottleneck stages to improve throughput by staggering the mini-batches across the replicas. Importantly, STAP achieves balanced pipelines without changing Occam's optimal partitioning. Our simulations show that Occam cuts off-chip transfers by 21x and achieves 2.06x and 1.36x better performance, and 33\% and 24\% better energy than the base case and Layer Fusion, respectively. On an FPGA implementation, Occam performs 5.1x better than the base case.


title: Secure Reversible Data Hiding in Encrypted Images Using Cipher-Feedback Secret Sharing

abstract: Reversible data hiding in encrypted images (RDH-EI) has attracted increasing attention, since it can protect the privacy of original images while the embedded data can be exactly extracted. Recently, some RDH-EI schemes with multiple data hiders have been proposed using secret sharing technique. However, these schemes protect the contents of the original images with lightweight security level. In this paper, we propose a high-security RDH-EI scheme with multiple data hiders. First, we introduce a cipher-feedback secret sharing (CFSS) technique. It follows the cryptography standards by introducing the cipher-feedback strategy of AES. Then, using the CFSS technique, we devise a new (r,n)-threshold (r<=n) RDH-EI scheme with multiple data hiders called CFSS-RDHEI. It can encrypt an original image into n encrypted images with reduced size using an encryption key and sends each encrypted image to one data hider. Each data hider can independently embed secret data into the encrypted image to obtain the corresponding marked encrypted image. The original image can be completely recovered from r marked encrypted images and the encryption key. Performance evaluations show that our CFSS-RDHEI scheme has high embedding rate and its generated encrypted images are much smaller, compared to existing secret sharing-based RDH-EI schemes. Security analysis demonstrates that it can achieve high security to defense some commonly used security attacks.


title: Permutations of point sets in $\mathbb{R}^d$

abstract: Given a set $S$ consisting of $n$ points in $\mathbb{R}^d$ and one or two vantage points, we study the number of orderings of $S$ induced by measuring the distance (for one vantage point) or the average distance (for two vantage points) from the vantage point(s) to the points of $S$ as the vantage points move through $\mathbb{R}^d.$ With one vantage point, a theorem of Good and Tideman \cite{MR505547} shows the maximum number of orderings is a sum of unsigned Stirling numbers of the first kind. We show that the minimum value in all dimensions is $2n-2,$ achieved by $n$ equally spaced points on a line. We investigate special configurations that achieve intermediate numbers of orderings in the one--dimensional and two--dimensional cases. We also treat the case when the points are on the sphere $S^2,$ connecting spherical and planar configurations. We briefly consider an application using weights suggested by an application to social choice theory. We conclude with several open problems that we believe deserve further study.


title: Demicaps in AG(4,3) and Their Relation to Maximal Cap Partitions

abstract: In this paper, we introduce a fundamental substructure of maximal caps in the affine geometry $AG(4,3)$ that we call \emph{demicaps}. Demicaps provide a direct link to particular partitions of $AG(4,3)$ into 4 maximal caps plus a single point. The full collection of 36 maximal caps that are in exactly one partition with a given cap $C$ can be expressed as unions of two disjoint demicaps taken from a set of 12 demicaps; these 12 can also be found using demicaps in $C$. The action of the affine group on these 36 maximal caps includes actions related to the outer automorphisms of $S_6$.


title: The fractional sum of small arithmetic functions

abstract: Motivated by recent results, we study sums of the form $S_f(x) = \sum_{n\leq x} f\left(\left\lfloor\frac{x}{n}\right\rfloor \right)$, where $f$ is an arithmetic function and $\left\lfloor\cdot\right\rfloor$ denotes the greatest integer function. We show how the error term in the asymptotic formula for $S_f(x)$ can be improved in some specific cases.


title: Sparse Control Synthesis for Uncertain Responsive Loads with Stochastic Stability Guarantees

abstract: Recent studies have demonstrated the potential of flexible loads in providing frequency response services. However, uncertainty and variability in various weather-related and end-use behavioral factors often affect the demand-side control performance. This work addresses this problem with the design of a demand-side control to achieve frequency response under load uncertainties. Our approach involves modeling the load uncertainties via stochastic processes that appear as both multiplicative and additive to the system states in closed-loop power system dynamics. Extending the recently developed mean square exponential stability (MSES) results for stochastic systems, we formulate multi-objective linear matrix inequality (LMI)-based optimal control synthesis problems to not only guarantee stochastic stability, but also promote sparsity, enhance closed-loop transient performance, and maximize allowable uncertainties. The fundamental trade-off between the maximum allowable (\textit{critical}) uncertainty levels and the optimal stochastic stabilizing control efforts is established. Moreover, the sparse control synthesis problem is generalized to the realistic power systems scenario in which only partial-state measurements are available. Detailed numerical studies are carried out on IEEE 39-bus system to demonstrate the closed-loop stochastic stabilizing performance of the sparse controllers in enhancing frequency response under load uncertainties; as well as illustrate the fundamental trade-off between the allowable uncertainties and optimal control efforts.


title: Learning-based Framework for Sensor Fault-Tolerant Building HVAC Control with Model-assisted Learning

abstract: As people spend up to 87% of their time indoors, intelligent Heating, Ventilation, and Air Conditioning (HVAC) systems in buildings are essential for maintaining occupant comfort and reducing energy consumption. These HVAC systems in smart buildings rely on real-time sensor readings, which in practice often suffer from various faults and could also be vulnerable to malicious attacks. Such faulty sensor inputs may lead to the violation of indoor environment requirements (e.g., temperature, humidity, etc.) and the increase of energy consumption. While many model-based approaches have been proposed in the literature for building HVAC control, it is costly to develop accurate physical models for ensuring their performance and even more challenging to address the impact of sensor faults. In this work, we present a novel learning-based framework for sensor fault-tolerant HVAC control, which includes three deep learning based components for 1) generating temperature proposals with the consideration of possible sensor faults, 2) selecting one of the proposals based on the assessment of their accuracy, and 3) applying reinforcement learning with the selected temperature proposal. Moreover, to address the challenge of training data insufficiency in building-related tasks, we propose a model-assisted learning method leveraging an abstract model of building physical dynamics. Through extensive experiments, we demonstrate that the proposed fault-tolerant HVAC control framework can significantly reduce building temperature violations under a variety of sensor fault patterns while maintaining energy efficiency.


title: An Approach to Causal Inference over Stochastic Networks

abstract: Claiming causal inferences in network settings necessitates careful consideration of the often complex dependency between outcomes for actors. Of particular importance are treatment spillover or outcome interference effects. We consider causal inference when the actors are connected via an underlying network structure. Our key contribution is a model for causality when the underlying network is unobserved and the actor covariates evolve stochastically over time. We develop a joint model for the relational and covariate generating process that avoids restrictive separability assumptions and deterministic network assumptions that do not hold in the majority of social network settings of interest. Our framework utilizes the highly general class of Exponential-family Random Network models (ERNM) of which Markov Random Fields (MRF) and Exponential-family Random Graph models (ERGM) are special cases. We present potential outcome based inference within a Bayesian framework, and propose a simple modification to the exchange algorithm to allow for sampling from ERNM posteriors. We present results of a simulation study demonstrating the validity of the approach. Finally, we demonstrate the value of the framework in a case-study of smoking over time in the context of adolescent friendship networks.


title: A second-order accurate numerical scheme for a time-fractional Fokker-Planck equation

abstract: A time-stepping $L1$ scheme for solving a time fractional Fokker-Planck equation of order $\alpha \in (0, 1)$, with a general driving force, is investigated. A stability bound for the semi-discrete solution is obtained for $\alpha\in(1/2,1)$ {via a novel and concise approach.} Our stability estimate is $\alpha$-robust in the sense that it remains valid in the limiting case where $\alpha$ approaches $1$ (when the model reduces to the classical Fokker-Planck equation), a limit that presents practical importance. Concerning the error analysis, we obtain an optimal second-order accurate estimate for $\alpha\in(1/2,1)$. A time-graded mesh is used to compensate for the singular behavior of the continuous solution near the origin. The $L1$ scheme is associated with a standard spatial Galerkin finite element discretization to numerically support our theoretical contributions. We employ the resulting fully-discrete computable numerical scheme to perform some numerical tests. These tests suggest that the imposed time-graded meshes assumption could be further relaxed, and we observe second-order accuracy even for the case $\alpha\in(0,1/2]$, that is, outside the range covered by the theory.


title: Cutting and Pasting in the Torelli subgroup of Out($F_n$)

abstract: Using ideas from 3-manifolds, Hatcher--Wahl defined a notion of automorphism groups of free groups with boundary. We study their Torelli subgroups, adapting ideas introduced by Putman for surface mapping class groups. Our main results show that these groups are finitely generated, and also that they satisfy an appropriate version of the Birman exact sequence.


title: Machine Learning Detection Algorithm for Large Barkhausen Jumps in Cluttered Environment

abstract: Modern magnetic sensor arrays conventionally utilize state of the art low power magnetometers such as parallel and orthogonal fluxgates. Low power fluxgates tend to have large Barkhausen jumps that appear as a dc jump in the fluxgate output. This phenomenon deteriorates the signal fidelity and effectively increases the internal sensor noise. Even if sensors that are more prone to dc jumps can be screened during production, the conventional noise measurement does not always catch the dc jump because of its sparsity. Moreover, dc jumps persist in almost all the sensor cores although at a slower but still intolerable rate. Even if dc jumps can be easily detected in a shielded environment, when deployed in presence of natural noise and clutter, it can be hard to positively detect them. This work fills this gap and presents algorithms that distinguish dc jumps embedded in natural magnetic field data. To improve robustness to noise, we developed two machine learning algorithms that employ temporal and statistical physical-based features of a pre-acquired and well-known experimental data set. The first algorithm employs a support vector machine classifier, while the second is based on a neural network architecture. We compare these new approaches to a more classical kernel-based method. To that purpose, the receiver operating characteristic curve is generated, which allows diagnosis ability of the different classifiers by comparing their performances across various operation points. The accuracy of the machine learning-based algorithms over the classic method is highly emphasized. In addition, high generalization and robustness of the neural network can be concluded, based on the rapid convergence of the corresponding receiver operating characteristic curves.


title: Capacity Analysis of Public Blockchain

abstract: As distributed ledgers, blockchains run consensus protocols which trade capacity for consistency, especially in non-ideal networks with incomplete connectivity and erroneous links. Existing studies on the tradeoff between capacity and consistency are only qualitative or rely on specific assumptions. This paper presents discrete-time Markov chain models to quantify the capacity of Proof-of-Work based public blockchains in non-ideal networks. The comprehensive model is collapsed to be ergodic under the eventual consistency of blockchains, achieving tractability and efficient evaluations of blockchain capacity. A closed-form expression for the capacity is derived in the case of two miners. Another important aspect is that we extend the ergodic model to analyze the capacity under strong consistency, evaluating the robustness of blockchains against double-spending attacks. Validated by simulations, the proposed models are accurate and reveal the effect of link quality and the distribution of mining rates on blockchain capacity and the ratio of stale blocks.


title: Image content dependent semi-fragile watermarking with localized tamper detection

abstract: Content-independent watermarks and block-wise independency can be considered as vulnerabilities in semi-fragile watermarking methods. In this paper to achieve the objectives of semi-fragile watermarking techniques, a method is proposed to not have the mentioned shortcomings. In the proposed method, the watermark is generated by relying on image content and a key. Furthermore, the embedding scheme causes the watermarked blocks to become dependent on each other, using a key. In the embedding phase, the image is partitioned into non-overlapping blocks. In order to detect and separate the different types of attacks more precisely, the proposed method embeds three copies of each watermark bit into LWT coefficients of each 4x4 block. In the authentication phase, by voting between the extracted bits the error maps are created; these maps indicate image authenticity and reveal the modified regions. Also, in order to automate the authentication, the images are classified into four categories using seven features. Classification accuracy in the experiments is 97.97 percent. It is noted that our experiments demonstrate that the proposed method is robust against JPEG compression and is competitive with a state-of-the-art semi-fragile watermarking method, in terms of robustness and semi-fragility.


title: Low power in-situ AI Calibration of a 3 Axial Magnetic Sensor

abstract: Magnetic surveys are conventionally performed by scanning a domain with a portable scalar magnetic sensor. Unfortunately, scalar magnetometers are expensive, power consuming and bulky. In many applications, calibrated vector magnetometers can be used to perform magnetic surveys. In recent years algorithms based on artificial intelligence (AI) achieve state-of-the-art results in many modern applications. In this work we investigate an AI algorithm for the classical scalar calibration of magnetometers. A simple, low cost method for performing a magnetic survey is presented. The method utilizes a low power consumption sensor with an AI calibration procedure that improves the common calibration methods and suggests an alternative to the conventional technology and algorithms. The setup of the survey system is optimized for quick deployment in-situ right before performing the magnetic survey. We present a calibration method based on a procedure of rotating the sensor in the natural earth magnetic field for an optimal time period. This technique can deal with a constant field offset and non-orthogonality issues and does not require any external reference. The calibration is done by finding an estimator that yields the calibration parameters and produces the best geometric fit to the sensor readings. A comprehensive model considering the physical, algorithmic and hardware properties of the magnetometer of the survey system is presented. The geometric ellipsoid fitting approach is parametrically tested. The calibration procedure reduced the root-mean-squared noise from the order of 104 nT to less than 10 nT with variance lower than 1 nT in a complete 360 degrees rotation in the natural earth magnetic field.


title: Who is Responsible for Adversarial Defense?

abstract: We have seen a surge in research aims toward adversarial attacks and defenses in AI/ML systems. While it is crucial to formulate new attack methods and devise novel defense strategies for robustness, it is also imperative to recognize who is responsible for implementing, validating, and justifying the necessity of these defenses. In particular, which components of the system are vulnerable to what type of adversarial attacks, and the expertise needed to realize the severity of adversarial attacks. Also how to evaluate and address the adversarial challenges in order to recommend defense strategies for different applications. This paper opened a discussion on who should examine and implement the adversarial defenses and the reason behind such efforts.


title: Automatic Differentiation With Higher Infinitesimals, or Computational Smooth Infinitesimal Analysis in Weil Algebra

abstract: We propose an algorithm to compute the $C^\infty$-ring structure of arbitrary Weil algebra. It allows us to do some analysis with higher infinitesimals numerically and symbolically. To that end, we first give a brief description of the (Forward-mode) automatic differentiation (AD) in terms of $C^\infty$-rings. The notion of a $C^\infty$-ring was introduced by Lawvere and used as the fundamental building block of smooth infinitesimal analysis and synthetic differential geometry. We argue that interpreting AD in terms of $C^\infty$-rings gives us a unifying theoretical framework and modular ways to express multivariate partial derivatives. In particular, we can "package" higher-order Forward-mode AD as a Weil algebra, and take tensor products to compose them to achieve multivariate higher-order AD. The algorithms in the present paper can also be used for a pedagogical purpose in learning and studying smooth infinitesimal analysis as well.

categories: cs.SC cs.MS cs.NA math.CT math.DG math.NA


title: Coarse-graining and symplectic non-squeezing

abstract: We address aspects of coarse-graining in classical Statistical Physics from the viewpoint of the symplectic non-squeezing theorem. We make some comments regarding the implications of the symplectic non-squeezing theorem for the BBGKY hierarchy. We also see the cubic cells appearing in coarse-graining as a direct consequence of the uniqueness of Hofer's metric on the group of Hamiltonian diffeomorphisms of the phase space.

categories: cond-mat.stat-mech gr-qc hep-th math-ph math.MP


title: Standardized long gamma-ray bursts as a cosmic distance indicator

abstract: Gamma-ray bursts (GRBs) are the most luminous explosions and can be detectable out to the edge of Universe. It has long been thought they can extend the Hubble diagram to very high redshifts. Several correlations between temporal or spectral properties and GRB luminosities have been proposed to make GRBs cosmological tools. However, those correlations cannot be properly standardized. In this paper, we select a long GRB sample with X-ray plateau phases produced by electromagnetic dipole emissions from central new-born magnetars. A tight correlation is found between the plateau luminosity and the end time of the plateau in X-ray afterglows out to the redshift $z=5.91$. We standardize these long GRBs X-ray light curves to a universal behavior by this correlation for the first time, with a luminosity dispersion of 0.5 dex. The derived distance-redshift relation of GRBs is in agreement with the standard $\Lambda$CDM model both at low and high redshifts. The evidence of accelerating universe from this GRB sample is $3\sigma$, which is the highest statistical significance from GRBs to date.


title: Post-Training Quantization for Vision Transformer

abstract: Recently, transformer has achieved remarkable performance on a variety of computer vision applications. Compared with mainstream convolutional neural networks, vision transformers are often of sophisticated architectures for extracting powerful feature representations, which are more difficult to be developed on mobile devices. In this paper, we present an effective post-training quantization algorithm for reducing the memory storage and computational costs of vision transformers. Basically, the quantization task can be regarded as finding the optimal low-bit quantization intervals for weights and inputs, respectively. To preserve the functionality of the attention mechanism, we introduce a ranking loss into the conventional quantization objective that aims to keep the relative order of the self-attention results after quantization. Moreover, we thoroughly analyze the relationship between quantization loss of different layers and the feature diversity, and explore a mixed-precision quantization scheme by exploiting the nuclear norm of each attention map and output feature. The effectiveness of the proposed method is verified on several benchmark models and datasets, which outperforms the state-of-the-art post-training quantization algorithms. For instance, we can obtain an 81.29\% top-1 accuracy using DeiT-B model on ImageNet dataset with about 8-bit quantization.


title: Analyzing Research Trends in Inorganic Materials Literature Using NLP

abstract: In the field of inorganic materials science, there is a growing demand to extract knowledge such as physical properties and synthesis processes of materials by machine-reading a large number of papers. This is because materials researchers refer to many papers in order to come up with promising terms of experiments for material synthesis. However, there are only a few systems that can extract material names and their properties. This study proposes a large-scale natural language processing (NLP) pipeline for extracting material names and properties from materials science literature to enable the search and retrieval of results in materials science. Therefore, we propose a label definition for extracting material names and properties and accordingly build a corpus containing 836 annotated paragraphs extracted from 301 papers for training a named entity recognition (NER) model. Experimental results demonstrate the utility of this NER model; it achieves successful extraction with a micro-F1 score of 78.1%. To demonstrate the efficacy of our approach, we present a thorough evaluation on a real-world automatically annotated corpus by applying our trained NER model to 12,895 materials science papers. We analyze the trend in materials science by visualizing the outputs of the NLP pipeline. For example, the country-by-year analysis indicates that in recent years, the number of papers on "MoS2," a material used in perovskite solar cells, has been increasing rapidly in China but decreasing in the United States. Further, according to the conditions-by-year analysis, the processing temperature of the catalyst material "PEDOT:PSS" is shifting below 200 degree, and the number of reports with a processing time exceeding 5 h is increasing slightly.


title: The Grasps Under Varied Object Orientation Dataset: Relation Between Grasps and Object Orientation

abstract: After a grasp has been planned, if the object orientation changes, the initial grasp may not have to be modified to accommodate the orientation change. For example, rotation of a cylinder by any amount around its centerline does not change its geometric shape relative to the grasper. Objects that can be approximated to solids of revolution or contain other geometric symmetries are prevalent in everyday life, and this information can be employed to improve the efficiency of existing grasp planning models. This paper experimentally investigates change in human-planned grasps under varied object orientations. With 13,440 recorded human grasps, our results indicate that during pick-and-place task of ordinary objects, stable grasps can be achieved with a small subset of grasp types, and the wrist-related parameters follow normal distribution.


title: The clustering of galaxies in the DESI imaging legacy surveys DR8: I. the luminosity and color dependent intrinsic clustering

abstract: In a recent study, we developed a method to model the impact of photometric redshift uncertainty on the two-point correlation function (2PCF). In this method, we can obtain both the intrinsic clustering strength and the photometric redshift errors simultaneously by fitting the projected 2PCF with two integration depths along the line-of-sight. Here we apply this method to the DESI Legacy Imaging Surveys Data Release 8 (LS DR8), the largest galaxy sample currently available. We separate galaxies into 20 samples in 8 redshift bins from $z=0.1$ to $z=1.0$, and a few $\rm z$-band absolute magnitude bins, with $M_{\rm z} \le -20$. These galaxies are further separated into red and blue sub-samples according to their $M^{0.5}_{\rm r}-M^{0.5}_{\rm z}$ colors. We measure the projected 2PCFs for all these galaxy (sub-)samples, and fit them using our photometric redshift 2PCF model. We find that the photometric redshift errors are smaller in red sub-samples than the overall population. On the other hand, there might be some systematic photometric redshift errors in the blue sub-samples, so that some of the sub-samples show significantly enhanced 2PCF at large scales. Therefore, focusing only on the red and all (sub-)samples, we find that the biases of galaxies in these (sub-)samples show clear color, redshift and luminosity dependencies, in that red brighter galaxies at higher redshift are more biased than their bluer and low redshift counterparts. Apart from the best fit set of parameters, $\sigma_{z}$ and $b$, from this state-of-the-art photometric redshift survey, we obtain high precision intrinsic clustering measurements for these 40 red and all galaxy (sub-)samples. These measurements on large and small scales hold important information regarding the cosmology and galaxy formation, which will be used in our subsequent probes in this series.


title: DenseTNT: Waymo Open Dataset Motion Prediction Challenge 1st Place Solution

abstract: In autonomous driving, goal-based multi-trajectory prediction methods are proved to be effective recently, where they first score goal candidates, then select a final set of goals, and finally complete trajectories based on the selected goals. However, these methods usually involve goal predictions based on sparse predefined anchors. In this work, we propose an anchor-free model, named DenseTNT, which performs dense goal probability estimation for trajectory prediction. Our model achieves state-of-the-art performance, and ranks 1st on the Waymo Open Dataset Motion Prediction Challenge. Project page is at https://github.com/Tsinghua-MARS-Lab/DenseTNT.


title: Tilting objects in singularity categories of toric Gorenstein varieties

abstract: We study certain toric Gorenstein varieties with isolated singularities which are the quotient spaces of generic unimodular representations by the one-dimensional torus, or by the product of the one-dimensional torus with a finite abelian group. Based on the works of \v{S}penko and Van den Bergh [Invent. Math. 210 (2017), no. 1, 3-67] and Mori and Ueyama [Adv. Math. 297 (2016), 54-92], we show that the singularity categories of these varieties admit tilting objects, and hence are triangle equivalent to the perfect categories of some finite dimensional algebras.


abstract: Face anti-spoofing (FAS) is an indispensable and widely used module in face recognition systems. Although high accuracy has been achieved, a FAS system will never be perfect due to the non-stationary applied environments and the potential emergence of new types of presentation attacks in real-world applications. In practice, given a handful of labeled samples from a new deployment scenario (target domain) and abundant labeled face images in the existing source domain, the FAS system is expected to perform well in the new scenario without sacrificing the performance on the original domain. To this end, we identify and address a more practical problem: Few-Shot Domain Expansion for Face Anti-Spoofing (FSDE-FAS). This problem is challenging since with insufficient target domain training samples, the model may suffer from both overfitting to the target domain and catastrophic forgetting of the source domain. To address the problem, this paper proposes a Style transfer-based Augmentation for Semantic Alignment (SASA) framework. We propose to augment the target data by generating auxiliary samples based on photorealistic style transfer. With the assistant of the augmented data, we further propose a carefully designed mechanism to align different domains from both instance-level and distribution-level, and then stabilize the performance on the source domain with a less-forgetting constraint. Two benchmarks are proposed to simulate the FSDE-FAS scenarios, and the experimental results show that the proposed SASA method outperforms state-of-the-art methods.