title: Extensions of Augmented Racks and Surface Ribbon Cocycle Invariants

abstract: A rack is a set with a binary operation that is right-invertible and self-distributive, properties diagrammatically corresponding to Reidemeister moves II and III, respectively. A rack is said to be an {\it augmented rack} if the operation is written by a group action. Racks and their cohomology theories have been extensively used for knot and knotted surface invariants. Similarly to group cohomology, rack 2-cocycles relate to extensions, and a natural question that arises is to characterize the extensions of augmented racks that are themselves augmented racks. In this paper, we characterize such extensions in terms of what we call {\it fibrant and additive} cohomology of racks. Simultaneous extensions of racks and groups are considered, where the respective $2$-cocycles are related through a certain formula. Furthermore, we construct coloring and cocycle invariants for compact orientable surfaces with boundary in ribbon forms embedded in $3$-space.


title: Ultralong Wave Focusing via Generalized Luneburg Lens

abstract: In this paper, a novel gradient index (GRIN) structural lens based on the concept of generalized Luneburg lens (GLL) is proposed. This lens allows for the realization of double foci and localization of energy flow between the two focal spots, thereby achieving ultralong focusing. The double-foci GRIN lens consists of two concentric circular regions with varying thickness defined in a thin plate structure. The two concentric circular regions are designed to realize continuous change of refractive indices with different profiles. Numerical simulations and experimental studies are performed to obtain the maximum displacement amplitude, full length at half maximum (FLHM), and full width at half maximum (FWHM) of the focal region of the lens. The results demonstrate that ultralong subwavelength focusing can be achieved for a broadband frequency range. In addition, our results show that the FLHM and FWHM can be tailored through the design of the focal length of the GLL. This offers a simple and flexible approach of engineering the GLL focusing characteristics and energy distributions for many applications.


title: Long-Exposure NuSTAR Constraints on Decaying Dark Matter in the Galactic Halo

abstract: We present two complementary NuSTAR x-ray searches for keV-scale dark matter decaying to mono-energetic photons in the Milky Way halo. In the first, we utilize the known intensity pattern of unfocused stray light across the detector planes -- the dominant source of photons from diffuse sources -- to separate astrophysical emission from internal instrument backgrounds using ${\sim}$7-Ms/detector deep blank-sky exposures. In the second, we present an updated parametric model of the full NuSTAR instrument background, allowing us to leverage the statistical power of an independent ${\sim}$20-Ms/detector stacked exposures spread across the sky. Finding no evidence of anomalous x-ray lines using either method, we set limits on the active-sterile mixing angle $\sin^2(2\theta)$ for sterile-neutrino masses 6--40 keV. The first key result is that we strongly disfavor a ${\sim}$7-keV sterile neutrino decaying into a 3.5-keV photon. The second is that we derive leading limits on sterile neutrinos with masses ${\sim}$15--18 keV and ${\sim}$25--40 keV, reaching or extending below the Big Bang Nucleosynthesis limit. In combination with previous results, the parameter space for the Neutrino Minimal Standard Model ($\nu$MSM) is now nearly closed.


title: Stability of the canonical extension of tangent bundles on Picard-rank-1 Fano varieties

abstract: We consider slope stability of the canonical extension of the tangent bundle by the trivial line bundle and with the extension class c_1(T_X) on Picard-rank-1 Fano varieties. In cases where the index divides the dimension or the dimension plus one, we show that stability of the tangent bundle implies (semi)stability of the canonical extension. One consequence of our result is that the canonical extensions on moduli spaces of stable vector bundles with a fixed determinant on a curve are at least semistable, and stable in some cases.


title: Brain-Aware Replacements for Supervised Contrastive Learning in Detection of Alzheimer's Disease

abstract: We propose a novel framework for Alzheimer's disease (AD) detection using brain MRIs. The framework starts with a data augmentation method called Brain-Aware Replacements (BAR), which leverages a standard brain parcellation to replace medically-relevant 3D brain regions in an anchor MRI from a randomly picked MRI to create synthetic samples. Ground truth "hard" labels are also linearly mixed depending on the replacement ratio in order to create "soft" labels. BAR produces a great variety of realistic-looking synthetic MRIs with higher local variability compared to other mix-based methods, such as CutMix. On top of BAR, we propose using a soft-label-capable supervised contrastive loss, aiming to learn the relative similarity of representations that reflect how mixed are the synthetic MRIs using our soft labels. This way, we do not fully exhaust the entropic capacity of our hard labels, since we only use them to create soft labels and synthetic MRIs through BAR. We show that a model pre-trained using our framework can be further fine-tuned with a cross-entropy loss using the hard labels that were used to create the synthetic samples. We validated the performance of our framework in a binary AD detection task against both from-scratch supervised training and state-of-the-art self-supervised training plus fine-tuning approaches. Then we evaluated BAR's individual performance compared to another mix-based method CutMix by integrating it within our framework. We show that our framework yields superior results in both precision and recall for the AD detection task.


title: A Waste Copper Granules Rating System Based on Machine Vision

abstract: In the field of waste copper granules recycling, engineers should be able to identify all different sorts of impurities in waste copper granules and estimate their mass proportion relying on experience before rating. This manual rating method is costly, lacking in objectivity and comprehensiveness. To tackle this problem, we propose a waste copper granules rating system based on machine vision and deep learning. We firstly formulate the rating task into a 2D image recognition and purity regression task. Then we design a two-stage convolutional rating network to compute the mass purity and rating level of waste copper granules. Our rating network includes a segmentation network and a purity regression network, which respectively calculate the semantic segmentation heatmaps and purity results of the waste copper granules. After training the rating network on the augmented datasets, experiments on real waste copper granules demonstrate the effectiveness and superiority of the proposed network. Specifically, our system is superior to the manual method in terms of accuracy, effectiveness, robustness, and objectivity.


title: The representation theory of Brauer categories II: curried algebra

abstract: A representation of $\mathfrak{gl}(V)=V \otimes V^*$ is a linear map $\mu \colon \mathfrak{gl}(V) \otimes M \to M$ satisfying a certain identity. By currying, giving a linear map $\mu$ is equivalent to giving a linear map $a \colon V \otimes M \to V \otimes M$, and one can translate the condition for $\mu$ to be a representation to a condition on $a$. This alternate formulation does not use the dual of $V$, and makes sense for any object $V$ in a tensor category $\mathcal{C}$. We call such objects representations of the curried general linear algebra on $V$. The currying process can be carried out for many algebras built out of a vector space and its dual, and we examine several cases in detail. We show that many well-known combinatorial categories are equivalent to the curried forms of familiar Lie algebras in the tensor category of linear species; for example, the titular Brauer category "is" the curried form of the symplectic Lie algebra. This perspective puts these categories in a new light, has some technical applications, and suggests new directions to explore.


title: Adaptive survival movement strategy to local epidemic outbreaks in cyclic models

abstract: We study the generalised rock-paper-scissors game with five species whose organisms face local epidemic outbreaks. As an evolutionary behavioural survival strategy, organisms of one out of the species move in the direction with more enemies of their enemies to benefit from protection against selection. We consider that each organism scans the environment, performing social distancing instead of agglomerating when perceiving that the density of sick organisms is higher than a tolerable threshold. Running stochastic simulations, we study the interference of the adaptive movement survival strategy in spatial pattern formation, calculating the characteristic length scale of the typical spatial domains inhabited by organisms of each species. We compute how social distancing trigger impacts the chances of an individual being killed in the cyclic game and contaminated by the disease. The outcomes show that the species predominates in the cyclic game because of the organisms' local adaptation. The territory occupied by the species grows with the proportion of individuals learning to trigger the social distancing tactic. We also show that organisms that perceive large distances more properly execute the adaptive strategy, promptly triggering the social distancing tactic and choosing the correct direction to move. Our findings may contribute to understanding the role of adaptive behaviour when environmental changes threaten biodiversity.

categories: q-bio.PE math.DS nlin.AO nlin.PS physics.app-ph


title: Bayesian Neural Networks for classification tasks in the Rubin big data era

abstract: Upcoming surveys such as the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) will detect up to 10 million time-varying sources in the sky every night for ten years. This information will be transmitted in a continuous stream to brokers that will select the most promising events for a variety of science cases using machine learning algorithms. We study the benefits and challenges of Bayesian Neural Networks (BNNs) for this type of classification tasks. BNNs are found to be accurate classifiers which also provide additional information: they quantify the classification uncertainty which can be harnessed to analyse this upcoming data avalanche more efficiently.


title: Reconfiguration and eruption of a solar filament by magnetic reconnection with an emerging magnetic field

abstract: Both observations and simulations suggest that the solar filament eruption is closely related to magnetic flux emergence. It is thought that the eruption is triggered by magnetic reconnection between the filament and the emerging flux. However, the details of such a reconnection are rarely presented. In this study, we report the detailed reconnection between a filament and its nearby emerging fields, that led to the reconfiguration and subsequent partial eruption of the filament located over the polarity inversion line of active region 12816. Before the reconnection, we observed repeated brightenings in the filament at a location that overlies a site of magnetic flux cancellation. Plasmoids form at this brightening region, and propagate bi-directionally along the filament. These indicate the tether-cutting reconnection that results in the formation and eruption of a flux rope. To the northwest of the filament, magnetic fields emerge, and reconnect with the context ones, resulting in repeated jets. Afterwards, another magnetic fields emerge near the northwestern filament endpoints, and reconnect with the filament, forming the newly reconnected filament and loops. Current sheet repeatedly occurs at the interface, with the mean temperature and emission measure of 1.7 MK and 1.1$\times$10$^{28}$ cm$^{-5}$. Plasmoids form in the current sheet, and propagate along it and further along the newly reconnected filament and loops. The newly reconnected filament then erupts, while the unreconnected filament remains stable. We propose that besides the orientation of emerging fields, some other parameters, such as the position, distance, strength, and area, are also crucial for triggering the filament eruption.


title: Computational coupled large-deformation periporomechanics for dynamic failure and fracturing in variably saturated porous media

abstract: The large-deformation mechanics and multiphysics of continuous or fracturing partially saturated porous media under static and dynamic loads are significant in engineering and science. This article is devoted to a computational coupled large-deformation periporomechanics paradigm assuming passive air pressure for modeling dynamic failure and fracturing in variably saturated porous media. The coupled governing equations for bulk and fracture material points are formulated in the current/deformed configuration through the updated Lagrangian-Eulerian framework. It is hypothesized that the horizon of a mixed material point remains spherical, and its neighbor points are determined in the current configuration. As a significant contribution, the mixed interface/phreatic material points near the phreatic line are explicitly considered for modeling the transition from partial to full saturation (vice versa) through the mixed peridynamic state concept. We have formulated the coupled constitutive correspondence principle and stabilization scheme in the updated Lagrangian-Eulerian framework for bulk and interface points. We numerically implement the coupled large deformation periporomechanics through a fully implicit fractional-step algorithm in time and a hybrid updated Lagrangian-Eulerian meshfree method in space. Numerical examples are presented to validate the implemented stabilized computational coupled large deformation periporomechanics and demonstrate its efficacy and robustness in modeling dynamic failure and fracturing in variably saturated porous media.


title: How Robust is your Fair Model? Exploring the Robustness of Diverse Fairness Strategies

abstract: With the introduction of machine learning in high-stakes decision making, ensuring algorithmic fairness has become an increasingly important problem to solve. In response to this, many mathematical definitions of fairness have been proposed, and a variety of optimisation techniques have been developed, all designed to maximise a defined notion of fairness. However, fair solutions are reliant on the quality of the training data, and can be highly sensitive to noise. Recent studies have shown that robustness (the ability for a model to perform well on unseen data) plays a significant role in the type of strategy that should be used when approaching a new problem and, hence, measuring the robustness of these strategies has become a fundamental problem. In this work, we therefore propose a new criterion to measure the robustness of various fairness optimisation strategies - the robustness ratio. We conduct multiple extensive experiments on five bench mark fairness data sets using three of the most popular fairness strategies with respect to four of the most popular definitions of fairness. Our experiments empirically show that fairness methods that rely on threshold optimisation are very sensitive to noise in all the evaluated data sets, despite mostly outperforming other methods. This is in contrast to the other two methods, which are less fair for low noise scenarios but fairer for high noise ones. To the best of our knowledge, we are the first to quantitatively evaluate the robustness of fairness optimisation strategies. This can potentially can serve as a guideline in choosing the most suitable fairness strategy for various data sets.


title: Numerical Approximations of the Allen-Cahn-Ohta-Kawasaki (ACOK) Equation with Modified Physics Informed Neural Networks (PINNs)

abstract: The physics informed neural networks (PINNs) has been widely utilized to numerically approximate PDE problems. While PINNs has achieved good results in producing solutions for many partial differential equations, studies have shown that it does not perform well on phase field models. In this paper, we partially address this issue by introducing a modified physics informed neural networks. In particular, they are used to numerically approximate Allen-Cahn-Ohta-Kawasaki (ACOK) equation with a volume constraint.


title: Robust gate design for large ion crystals through excitation of local phonon modes

abstract: We propose a scalable design of entangling quantum gates for large ion crystals with the following desirable features: 1) The gate design is universal and applicable for large ion crystals of arbitrary sizes; 2) The gate has no speed limitation and can work outside of the Lamb-Dicke region; 3) The gate operates by driving from either continuous-wave or pulsed laser beams; 4) The gate is insensitive to slow variation of the laser optical phase and works under a thermal state for the ions' motion; 5) The intrinsic gate infidelity can be reduced to a level well below the threshold for fault-tolerant quantum computation under realistic experimental parameters. Different from the previous gate schemes, here we propose a gate design based on driving of the local oscillation mode of the ions instead of the collective normal modes and develop a formalism based on the Heisenberg equations to deal with the many-body quantum dynamics outside of the Lamb-Dicke region.


title: HEGrid: A High Efficient Multi-Channel Radio Astronomical Data Gridding Framework in Heterogeneous Computing Environments

abstract: The challenge to fully exploit the potential of existing and upcoming scientific instruments like large single-dish radio telescopes is to process the collected massive data effectively and efficiently. As a "quasi 2D stencil computation" with the "Moore neighborhood pattern," gridding is the most computationally intensive step in data reduction pipeline for radio astronomy studies, enabling astronomers to create correct sky images for further analysis. However, the existing gridding frameworks can either only run on multi-core CPU architecture or do not support high-concurrency, multi-channel data gridding. Their performance is then limited, and there are emerging needs for innovative gridding frameworks to process data from large single-dish radio telescopes like the Five-hundred-meter Aperture Spherical Telescope (FAST). To address those challenges, we developed a High Efficient Gridding framework, HEGrid, by overcoming the above limitations. Specifically, we propose and construct the gridding pipeline in heterogeneous computing environments and achieve multi-pipeline concurrency for high performance multi-channel processing. Furthermore, we propose pipeline-based co-optimization to alleviate the potential negative performance impact of possible intra- and inter-pipeline low computation and I/O utilization, including component share-based redundancy elimination, thread-level data reuse and overlapping I/O and computation. Our experiments are based on both simulated datasets and actual FAST observational datasets. The results show that HEGrid outperforms other state-of-the-art gridding frameworks by up to 5.5x and has robust hardware portability, including AMD Radeon Instinct GPU and NVIDIA GPU.


title: A multi-level interpretable sleep stage scoring system by infusing experts' knowledge into a deep network architecture

abstract: In recent years, deep learning has shown potential and efficiency in a wide area including computer vision, image and signal processing. Yet, translational challenges remain for user applications due to a lack of interpretability of algorithmic decisions and results. This black box problem is particularly problematic for high-risk applications such as medical-related decision-making. The current study goal was to design an interpretable deep learning system for time series classification of electroencephalogram (EEG) for sleep stage scoring as a step toward designing a transparent system. We have developed an interpretable deep neural network that includes a kernel-based layer based on a set of principles used for sleep scoring by human experts in the visual analysis of polysomnographic records. A kernel-based convolutional layer was defined and used as the first layer of the system and made available for user interpretation. The trained system and its results were interpreted in four levels from the microstructure of EEG signals, such as trained kernels and the effect of each kernel on the detected stages, to macrostructures, such as the transition between stages. The proposed system demonstrated greater performance than prior studies and the results of interpretation showed that the system learned information which was consistent with expert knowledge.


title: PF4Microservices: A decomposion scheme for microservices based on Problem Frames

abstract: In recent years, microservice architecture has become a popular architectural style in software engineering, with its natural support for DevOps and continuous delivery, as well as its scalability and extensibility, which drive industry practitioners to migrate to microservice architecture. However, there are many challenges in adopting a microservice architecture, the most important of which is how to properly decomposition a monolithic system into microservices. Currently, microservice decomposition decisions for monolithic systems rely on subjective human experience, which is a costly, time-consuming process with high uncertainty of results. To address this problem, this paper proposes a method for microservice decomposition using Jackson Problem Frames. In this method, requirements of the system are analysed, descriptions of the interactions between the proposed software and its environment is obtained, multiple problem diagrams are constructed, and then the problem diagrams are merged by analyzing the correlation and similarity between them, resulting in a microservice decomposition scheme. A case study is also conducted based on a smart parking system. The results of the study show that the method can perform microservice decomposition based on requirements and the software environment, resulting in reducing the decisionmaking burden of developers, with reasonable decomposition results.


title: Gradual Domain Adaptation without Indexed Intermediate Domains

abstract: The effectiveness of unsupervised domain adaptation degrades when there is a large discrepancy between the source and target domains. Gradual domain adaptation (GDA) is one promising way to mitigate such an issue, by leveraging additional unlabeled data that gradually shift from the source to the target. Through sequentially adapting the model along the "indexed" intermediate domains, GDA substantially improves the overall adaptation performance. In practice, however, the extra unlabeled data may not be separated into intermediate domains and indexed properly, limiting the applicability of GDA. In this paper, we investigate how to discover the sequence of intermediate domains when it is not already available. Concretely, we propose a coarse-to-fine framework, which starts with a coarse domain discovery step via progressive domain discriminator training. This coarse domain sequence then undergoes a fine indexing step via a novel cycle-consistency loss, which encourages the next intermediate domain to preserve sufficient discriminative knowledge of the current intermediate domain. The resulting domain sequence can then be used by a GDA algorithm. On benchmark data sets of GDA, we show that our approach, which we name Intermediate DOmain Labeler (IDOL), can lead to comparable or even better adaptation performance compared to the pre-defined domain sequence, making GDA more applicable and robust to the quality of domain sequences. Codes are available at https://github.com/hongyouc/IDOL.


title: Multi-Study Boosting: Theoretical Considerations for Merging vs. Ensembling

abstract: Cross-study replicability is a powerful model evaluation criterion that emphasizes generalizability of predictions. When training cross-study replicable prediction models, it is critical to decide between merging and treating the studies separately. We study boosting algorithms in the presence of potential heterogeneity in predictor-outcome relationships across studies and compare two multi-study learning strategies: 1) merging all the studies and training a single model, and 2) multi-study ensembling, which involves training a separate model on each study and ensembling the resulting predictions. In the regression setting, we provide theoretical guidelines based on an analytical transition point to determine whether it is more beneficial to merge or to ensemble for boosting with linear learners. In addition, we characterize a bias-variance decomposition of estimation error for boosting with component-wise linear learners. We verify the theoretical transition point result in simulation and illustrate how it can guide the decision on merging vs. ensembling in an application to breast cancer gene expression data.


title: Learned Video Compression via Heterogeneous Deformable Compensation Network

abstract: Learned video compression has recently emerged as an essential research topic in developing advanced video compression technologies, where motion compensation is considered one of the most challenging issues. In this paper, we propose a learned video compression framework via heterogeneous deformable compensation strategy (HDCVC) to tackle the problems of unstable compression performance caused by single-size deformable kernels in downsampled feature domain. More specifically, instead of utilizing optical flow warping or single-size-kernel deformable alignment, the proposed algorithm extracts features from the two adjacent frames to estimate content-adaptive heterogeneous deformable (HetDeform) kernel offsets. Then we transform the reference features with the HetDeform convolution to accomplish motion compensation. Moreover, we design a Spatial-Neighborhood-Conditioned Divisive Normalization (SNCDN) to achieve more effective data Gaussianization combined with the Generalized Divisive Normalization. Furthermore, we propose a multi-frame enhanced reconstruction module for exploiting context and temporal information for final quality enhancement. Experimental results indicate that HDCVC achieves superior performance than the recent state-of-the-art learned video compression approaches.


title: Cross-Section Continuity of Definitions of Angular Momentum

abstract: We introduce a notion of "cross-section continuity" as a criterion for the viability of definitions of angular momentum, $J$, at null infinity: If a sequence of cross-sections, ${\mathcal C}_n$, of null infinity converges uniformly to a cross-section ${\mathcal C}$, then the angular momentum, $J_n$, on ${\mathcal C}_n$ should converge to the angular momentum, $J$, on ${\mathcal C}$. The Dray-Streubel (DS) definition of angular momentum automatically satisfies this criterion by virtue of the existence of a well defined flux associated with this definition. However, we show that the one-parameter modification of the DS definition proposed by Compere and Nichols (CN) -- which encompasses numerous other alternative definitions -- does not satisfy cross-section continuity. On the other hand, we prove that the Chen-Wang-Yau (CWY) definition does satisfy the cross-section continuity criterion.


title: Hybrid iLQR Model Predictive Control for Contact Implicit Stabilization on Legged Robots

abstract: Model Predictive Control (MPC) is a popular strategy for controlling robots but is difficult for systems with contact due to the complex nature of hybrid dynamics. To implement MPC for systems with contact, dynamic models are often simplified or contact sequences fixed in time in order to plan trajectories efficiently. In this work, we extend Hybrid iterative Linear Quadratic Regulator to work in a MPC fashion (HiLQR MPC) by 1) modifying how the cost function is computed when contact modes do not align, 2) utilizing parallelizations when simulating rigid body dynamics, and 3) using efficient analytical derivative computations of the rigid body dynamics. The result is a system that can modify the contact sequence of the reference behavior and plan whole body motions cohesively -- which is crucial when dealing with large perturbations. HiLQR MPC is tested on two systems: first, the hybrid cost modification is validated on a simple actuated bouncing ball hybrid system. Then HiLQR MPC is compared against methods that utilize centroidal dynamic assumptions on a quadruped robot (Unitree A1). HiLQR MPC outperforms the centroidal methods in both simulation and hardware tests.


title: Evolution of AM CVn binaries with WD donors

abstract: The evolution and stability of mass transfer of CO+He WD binaries are not well understood. Observationally they may emerge as AM CVn binaries and are important gravitational wave (GW) emitters. In this work, we have modeled the evolution of double WD binaries with accretor masses of $0.50 - 1.30\;M_{\odot}$ and donor masses of $0.17\; - 0.45\;M_{\odot}$ using the detailed stellar evolution code MESA. We find that the evolution of binaries with same donor masses but different accretor masses is very similar and binaries with same accretor masses but larger He donor masses have larger maximum mass transfer rates and smaller minimum orbital periods. We also demonstrate that the GW signal from AM CVn binaries can be detected by space-borne GW observatories, such as LISA, TianQin. And there is a linear relation between the donor mass and gravitational wave frequency during mass transfer phase. In our calculation, all binaries can have dynamically stable mass transfer, which is very different from previous studies. The threshold donor mass of Eddington-limited mass transfer for a given accretor WD mass is lower than previous studies. Assuming that a binary may enter common envelope if the mass transfer rate exceeds the maximum stable burning rate of He, we provide a new criterion for double WDs surviving mass transfer, which is below the threshold of Eddington-limit. Finally, we find that some systems with ONe WDs in our calculation may evolve into detached binaries consisting of neutron stars (NSs) and extremely low mass He WDs and further ultra-compact X-ray binaries.


title: Higher-dimensional performance of port-based teleportation

abstract: Port-based teleportation (PBT) is a variation of regular quantum teleportation that operates without a final unitary correction. However, its behavior for higher-dimensional systems has been hard to calculate explicitly beyond dimension $d=2$. Indeed, relying on conventional Hilbert-space representations entails an exponential overhead with increasing dimension. Some general upper and lower bounds for various success measures, such as (entanglement) fidelity, are known, but some become trivial in higher dimensions. Here we construct a graph-theoretic algebra (a subset of Temperley-Lieb algebra) which allows us to explicitly compute the higher-dimensional performance of PBT for so-called "pretty-good measurements" with negligible representational overhead. This graphical algebra allows us to explicitly compute the success probability to distinguish the different outcomes and fidelity for arbitrary dimension $d$ and low number of ports $N$, obtaining in addition a simple upper bound. The results for low $N$ and arbitrary $d$ show that the fidelity asymptotically approaches ${N}/{d^2}$ for large $d$, confirming the performance of one lower bound from the literature.


title: Cluster Resource Management for Dynamic Workloads by Online Optimization

abstract: Over the past ten years, many different approaches have been proposed for different aspects of the problem of resources management for long running, dynamic and diverse workloads such as processing query streams or distributed deep learning. Particularly for applications consisting of containerized microservices, researchers have attempted to address problems of dynamic selection of, for example: types and quantities of virtualized services (e.g., IaaS/VMs), vertical and horizontal scaling of different microservices, assigning microservices to VMs, task scheduling, or some combination thereof. In this context, we argue that frameworks like simulated annealing are highly suitable for online navigation of trade-offs between performance (SLO) and cost, particularly when the complex workloads and cloud-service offerings vary over time. Based on a macroscopic objective that combines both performance and cost terms, annealing facilitates light-weight and coherent policies of exploration and exploitation. In this paper, we first give some background on simulated annealing and then experimentally demonstrate its usefulness for different case studies, including service selection for both a single type of workload (e.g., distributed deep learning) and a mixture of workload types (exploring a partially categorical set of options), and container sizing for microservice benchmarks. We conclude with a discussion of how the basic annealing platform can be applied to other resource-management problems, hybridized with other methods, and accommodate user-specified rules of thumb.


title: A multivariate semi-parametric portfolio risk optimization and forecasting framework

abstract: We develop a novel multivariate semi-parametric modelling approach to portfolio Value-at-Risk (VaR) and Expected Shortfall (ES) forecasting. Differently from existing univariate semi-parametric approaches, the proposed framework involves explicit modelling of the dependence structure among portfolio asset returns through a dynamic conditional correlation (DCC) parameterization. Model parameters are estimated through a two-step procedure based on the minimization of strictly consistent scoring functions derived from the Asymmetric Laplace (AL) distribution. The proposed model is consequently denominated as DCC-AL. The performance of the DCC-AL in risk forecasting and portfolio optimization is assessed by means of a forecasting study on the components of the Dow Jones index for an out-of-sample period from December 2016 to September 2021. The empirical results support the proposed model class, comparing to a variety of existing approaches, in terms of risk forecasting and portfolio optimization.


title: Frequency-Angle Two-Dimensional Reflection Coefficient Modeling Based on Terahertz Channel Measurement

abstract: Terahertz (THz) channel propagation characteristics are vital for the design, evaluation, and optimization for THz communication systems. Moreover, reflection plays a significant role in channel propagation. In this letter, the reflection coefficient of the THz channel is researched based on extensive measurement campaigns. Firstly, we set up the THz channel sounder from 220 to 320 GHz with the incident angle ranging from 10{\deg} to 80{\deg}. Based on the measured propagation loss, the reflection coefficients of five building materials, i.e., glass, tile, aluminium alloy, board, and plasterboard, are calculated separately for frequencies and incident angles. It is found that the lack of THz relative parameters leads to the Fresnel model of non-metallic materials can not fit the measured data well. Thus, we propose a frequency-angle two-dimensional reflection coefficient model by modifying the Fresnel model with the Lorenz and Drude model. The proposed model characterizes the frequency and incident angle for reflection coefficients and shows low root-mean-square error with the measured data. Generally, these results are useful for modeling THz channels.


title: Optimizing nonadiabatic geometric quantum gates against off-resonance error by dynamical correction in a silicon-based spin qubit

abstract: Geometric quantum gates are performed by using the geometric phase, making them particularly robust to the pulse amplitude error due to the intrinsic global property. However, in many systems, such as the silicon-based spin qubits, the off-resonance error is the dominant noise, which can cause dephasing and is always difficult to deal with for a geometric gate. Thus how to deal with the off-resonance error is very significant for the application of the geometric gates. A recent work in \emph{Phy. Rev. Appl. 16, 044005 (2021)} reveals that by inserting two $\pi$-pulse dynamically corrected sequences into the evolution paths, the holonomic quantum gate is effective to suppress the pulse amplitude error, however it is still useless for combating the off-resonance error. Inspired by this work, we combine using the techniques of dynamical correction and path design. Surprisingly, we find that by picking up a specific evolution path inserted by only a $\pi$-pulse dynamically corrected sequence, the obtained optimized geometric gate is robust to the off-resonance error, assuming the noise is static. Further, by calculating the filter function considering the realistic $1/f$-type noise in silicon, the related results show that the performance of the optimized geometric gate can also surpass both the conventional geometric gate and the naive dynamical gate constructed without using the geometric phase. Our results indicate dynamical correction is an powerful tool to improve the geometric gate.


title: Differential item functioning via robust scaling

abstract: This paper proposes a method for assessing differential item functioning (DIF) in item response theory (IRT) models. The method does not require pre-specification of anchor items, which is its main virtue. It is developed in two main steps, first by showing how DIF can be re-formulated as a problem of outlier detection in IRT-based scaling, then tackling the latter using methods from robust statistics. The proposal is a redescending M-estimator of IRT scaling parameters that is tuned to flag items with DIF at the desired asymptotic Type I Error rate. Theoretical results describe the efficiency of the estimator in the absence of DIF and its robustness in the presence of DIF. Simulation studies show that the proposed method compares favorably to currently available approaches for DIF detection, and a real data example illustrates its application in a research context where pre-specification of anchor items is infeasible. The focus of the paper is the two-parameter logistic model in two independent groups, with extensions to other settings considered in the conclusion.


title: A lower bound of the energy of non-singular graphs in terms of average degree

abstract: Let $G$ be a graph of order $n$ with adjacency matrix $A(G)$. The \textit{energy} of graph $G$, denoted by $\mathcal{E}(G)$, is defined as the sum of absolute value of eigenvalues of $A(G)$. It was conjectured that if $A(G)$ is non-singular, then $\mathcal{E}(G)\geq\Delta(G)+\delta(G)$. In this paper we propose a stronger conjecture as for $n \geq 5$, $\mathcal{E}(G)\geq n-1+ d$, where $d$ is the average degree of $G$. Here, we show that conjecture holds for bipartite graphs, planar graphs and for the graphs with $d \leq n-2\ln n -3$


title: Optimal Clustering by Lloyd Algorithm for Low-Rank Mixture Model

abstract: This paper investigates the computational and statistical limits in clustering matrix-valued observations. We propose a low-rank mixture model (LrMM), adapted from the classical Gaussian mixture model (GMM) to treat matrix-valued observations, which assumes low-rankness for population center matrices. A computationally efficient clustering method is designed by integrating Lloyd's algorithm and low-rank approximation. Once well-initialized, the algorithm converges fast and achieves an exponential-type clustering error rate that is minimax optimal. Meanwhile, we show that a tensor-based spectral method delivers a good initial clustering. Comparable to GMM, the minimax optimal clustering error rate is decided by the separation strength, i.e., the minimal distance between population center matrices. By exploiting low-rankness, the proposed algorithm is blessed with a weaker requirement on the separation strength. Unlike GMM, however, the computational difficulty of LrMM is characterized by the signal strength, i.e., the smallest non-zero singular values of population center matrices. Evidence is provided showing that no polynomial-time algorithm is consistent if the signal strength is not strong enough, even though the separation strength is strong. Intriguing differences between estimation and clustering under LrMM are discussed. The merits of low-rank Lloyd's algorithm are confirmed by comprehensive simulation experiments. Finally, our method outperforms others in the literature on real-world datasets.

categories: math.ST cs.IT cs.LG math.IT stat.ME stat.TH


title: Some Discussions on PHY Security in DF Relay

abstract: Physical layer (PHY) security in decode-and-forward (DF) relay systems is discussed. Based on the types of wiretap links, the secrecy performance of three typical secure DF relay models is analyzed. Different from conventional works in this field, rigorous derivations of the secrecy channel capacity are provided from an information-theoretic perspective. Meanwhile, closed-form expressions are derived to characterize the secrecy outage probability (SOP). For the sake of unveiling more system insights, asymptotic analyses are performed on the SOP for a sufficiently large signal-to-noise ratio (SNR). The analytical results are validated by computer simulations and are in excellent agreement.


title: Adaptive Fine-Grained Predicates Learning for Scene Graph Generation

abstract: The performance of current Scene Graph Generation (SGG) models is severely hampered by hard-to-distinguish predicates, e.g., woman-on/standing on/walking on-beach. As general SGG models tend to predict head predicates and re-balancing strategies prefer tail categories, none of them can appropriately handle hard-to-distinguish predicates. To tackle this issue, inspired by fine-grained image classification, which focuses on differentiating hard-to-distinguish objects, we propose an Adaptive Fine-Grained Predicates Learning (FGPL-A) which aims at differentiating hard-to-distinguish predicates for SGG. First, we introduce an Adaptive Predicate Lattice (PL-A) to figure out hard-to-distinguish predicates, which adaptively explores predicate correlations in keeping with model's dynamic learning pace. Practically, PL-A is initialized from SGG dataset, and gets refined by exploring model's predictions of current mini-batch. Utilizing PL-A, we propose an Adaptive Category Discriminating Loss (CDL-A) and an Adaptive Entity Discriminating Loss (EDL-A), which progressively regularize model's discriminating process with fine-grained supervision concerning model's dynamic learning status, ensuring balanced and efficient learning process. Extensive experimental results show that our proposed model-agnostic strategy significantly boosts performance of benchmark models on VG-SGG and GQA-SGG datasets by up to 175% and 76% on Mean Recall@100, achieving new state-of-the-art performance. Moreover, experiments on Sentence-to-Graph Retrieval and Image Captioning tasks further demonstrate practicability of our method.


title: Small set of orthogonal product states with nonlocality

abstract: A set of orthogonal states in multipartite systems is called to be locally stable if to preserving the orthogonality of the states, only trivial local measurement can be performed from each partite. Locally stable set of states are always locally indistinguishable yielding a form of nonlocality which is different from the Bell type nonlocality. In this work, we study the locally stable set of product states with small size. First, we give a lower bound on the size of locally stable set of product states. It is well known that unextendible product basis (UPB) is locally indistinguishable. But we find that some of them are not locally stable. On the other hand, there exists some small subset of minimum size UPB that are also locally stable which implies the nonlocality of such UPBs are stronger than other form.


title: Privacy-preserving Decentralized Deep Learning with Multiparty Homomorphic Encryption

abstract: Decentralized deep learning plays a key role in collaborative model training due to its attractive properties, including tolerating high network latency and less prone to single-point failures. Unfortunately, such a training mode is more vulnerable to data privacy leaks compared to other distributed training frameworks. Existing efforts exclusively use differential privacy as the cornerstone to alleviate the data privacy threat. However, it is still not clear whether differential privacy can provide a satisfactory utility-privacy trade-off for model training, due to its inherent contradictions. To address this problem, we propose D-MHE, the first secure and efficient decentralized training framework with lossless precision. Inspired by the latest developments in the homomorphic encryption technology, we design a multiparty version of Brakerski-Fan-Vercauteren (BFV), one of the most advanced cryptosystems, and use it to implement private gradient updates of users'local models. D-MHE can reduce the communication complexity of general Secure Multiparty Computation (MPC) tasks from quadratic to linear in the number of users, making it very suitable and scalable for large-scale decentralized learning systems. Moreover, D-MHE provides strict semantic security protection even if the majority of users are dishonest with collusion. We conduct extensive experiments on MNIST and CIFAR-10 datasets to demonstrate the superiority of D-MHE in terms of model accuracy, computation and communication cost compared with existing schemes.


title: Analytic Implicit Functions

abstract: In this paper, we introduce a method of converting implicit equations to the usual forms of functions locally without differentiability. For a system of implicit equations which are equipped with continuous functions, if there are unique analytic implicit functions, that satisfies the system in some rectangle, then each analytic function is represented as a power series which is the weak-star limit of partial sums in the space of essentially bounded functions. We also provide numerical examples in order to demonstrate how the theoretical results in this article can be applied in practice and to show the effectiveness of the suggested approaches.


title: SparseTIR: Composable Abstractions for Sparse Compilation in Deep Learning

abstract: Sparse tensors are rapidly becoming critical components of modern deep learning workloads. However, developing high-performance sparse operators can be difficult and tedious, and existing vendor libraries cannot satisfy the escalating demands from new operators. Sparse tensor compilers simplify the development of operators, but efficient sparse compilation for deep learning remains challenging because a single sparse format cannot maximize hardware efficiency, and single-shot compilers cannot keep up with latest hardware and system advances. In this paper, we observe that the key to addressing both these challenges is to leverage composable formats and composable transformations. We propose SparseTIR, a sparse tensor compilation abstraction that offers composable formats and composable transformations for deep learning workloads. SparseTIR constructs a search space over these composable components for performance tuning. With these improvements, SparseTIR obtains consistent performance speedups vs vendor libraries on GPUs for single operators: 1.20-2.34x for GNN operators, 1.05-2.98x for sparse attention operators, and 0.56-7.45x for sparse convolution operators. SparseTIR also accelerates end-to-end GNNs by 1.08-1.52x for GraphSAGE training, and 4.20-40.18x for RGCN inference.


title: A Penalty Approach for Normalizing Feature Distributions to Build Confounder-Free Models

abstract: Translating machine learning algorithms into clinical applications requires addressing challenges related to interpretability, such as accounting for the effect of confounding variables (or metadata). Confounding variables affect the relationship between input training data and target outputs. When we train a model on such data, confounding variables will bias the distribution of the learned features. A recent promising solution, MetaData Normalization (MDN), estimates the linear relationship between the metadata and each feature based on a non-trainable closed-form solution. However, this estimation is confined by the sample size of a mini-batch and thereby may cause the approach to be unstable during training. In this paper, we extend the MDN method by applying a Penalty approach (referred to as PDMN). We cast the problem into a bi-level nested optimization problem. We then approximate this optimization problem using a penalty method so that the linear parameters within the MDN layer are trainable and learned on all samples. This enables PMDN to be plugged into any architectures, even those unfit to run batch-level operations, such as transformers and recurrent models. We show improvement in model accuracy and greater independence from confounders using PMDN over MDN in a synthetic experiment and a multi-label, multi-site dataset of magnetic resonance images (MRIs).


title: Frictional weakening of vibrated granular flows

abstract: We computationally study the frictional properties of sheared granular media subjected to harmonic vibration applied at the boundary. Such vibrations are thought to play an important role in weakening flows, yet the independent effects of amplitude, frequency, and pressure on the process have remained unclear. Based on a dimensional analysis and DEM simulations, we show that, in addition to a previously proposed criterion for peak acceleration that leads to breaking of contacts, weakening requires the absolute amplitude squared of the displacement is sufficiently large relative to the confining pressure. The analysis provides a basis for predicting flows subjected to arbitrary external vibration and demonstrates that a previously unrecognized second process that is dependent on dissipation contributes to shear weakening under vibrations.


title: Texture zeros of quark mass matrices at fixed point $\tau=\omega$ in modular flavor symmetry

abstract: We study systematically derivation of the specific texture zeros, that is the nearest neighbor interaction (NNI) form of the quark mass matrices at the fixed point $\tau=\omega$ in modular flavor symmetric models. We present models that the NNI forms of the quark mass matrices are simply realized at the fixed point $\tau=\omega$ in the $A_4$ modular flavor symmetry by taking account multi-Higgs fields. Such texture zero structure originates from the $ST$ charge of the residual symmetry $Z_3$ of $SL(2,Z)$. The NNI form can be realized at the fixed point $\tau = \omega$ in $A_4$ and $S_4$ modular flavor models with two pairs of Higgs fields when we assign properly modular weights to Yukawa couplings and $A_4$ and $S_4$ representations to three generations of quarks. We need four pairs of Higgs fields to realize the NNI form in $A_5$ modular flavor models.


title: Second largest accumulation point of minimal log discrepancies of threefolds

abstract: The second largest accumulation point of the set of minimal log discrepancies of threefolds is $\frac{5}{6}$. In particular, the minimal log discrepancies of $\frac{5}{6}$-lc threefolds satisfy the ACC.


title: A Strong Law of Large Numbers under Sublinear Expectations

abstract: We consider a sequence of i.i.d. random variables $\{\xi_k\}$under a sublinear expectation $\mathbb{E}=\sup_{P\in\Theta}E_P$. We first give a new proof to the fact that, under each $P\in\Theta$, any cluster point of the empirical averages $\bar{\xi}_n=(\xi_1+\cdots+\xi_n)/n$ lies in $[\underline{\mu}, \bar{\mu}]$ with $\underline{\mu}=-\mathbb{E}[-\xi_1], \bar{\mu}=\mathbb{E}[\xi_1]$. Then, we consider sublinear expectations on a Polish space $\Omega$, and show that for each constant $\mu\in [\underline{\mu},\bar{\mu}]$, there exists a probability $P_{\mu}\in\Theta$ such that \begin {eqnarray}\label {intro-a.s.} \lim_{n\rightarrow\infty}\bar{\xi}_n=\mu, \ P_{\mu}\textmd{-a.s.}, \end {eqnarray} supposing that $\Theta$ is weakly compact and $\{\xi_n\}\in L^1_{\mathbb{E}}(\Omega)$. Under the same conditions, we can get a generalization of (\ref {intro-a.s.}) in the product space $\Omega=\mathbb{R}^{\mathbb{N}}$ with $\mu\in [\underline{\mu},\bar{\mu}]$ replaced by $\Pi=\pi(\xi_1, \cdots,\xi_d)\in [\underline{\mu},\bar{\mu}]$, where $\pi$ is a Borel measurable function on $\mathbb{R}^d$, $d\in\mathbb{R}$. Finally, we characterize the triviality of the tail $\sigma$-algebra of i.i.d. random variables under a sublinear expectation.


title: Synergy and Symmetry in Deep Learning: Interactions between the Data, Model, and Inference Algorithm

abstract: Although learning in high dimensions is commonly believed to suffer from the curse of dimensionality, modern machine learning methods often exhibit an astonishing power to tackle a wide range of challenging real-world learning problems without using abundant amounts of data. How exactly these methods break this curse remains a fundamental open question in the theory of deep learning. While previous efforts have investigated this question by studying the data (D), model (M), and inference algorithm (I) as independent modules, in this paper, we analyze the triplet (D, M, I) as an integrated system and identify important synergies that help mitigate the curse of dimensionality. We first study the basic symmetries associated with various learning algorithms (M, I), focusing on four prototypical architectures in deep learning: fully-connected networks (FCN), locally-connected networks (LCN), and convolutional networks with and without pooling (GAP/VEC). We find that learning is most efficient when these symmetries are compatible with those of the data distribution and that performance significantly deteriorates when any member of the (D, M, I) triplet is inconsistent or suboptimal.


title: Nonlinear Sufficient Dimension Reduction for Distribution-on-Distribution Regression

abstract: We introduce a new approach to nonlinear sufficient dimension reduction in cases where both the predictor and the response are distributional data, modeled as members of a metric space. Our key step is to build universal kernels (cc-universal) on the metric spaces, which results in reproducing kernel Hilbert spaces for the predictor and response that are rich enough to characterize the conditional independence that determines sufficient dimension reduction. For univariate distributions, we construct the universal kernel using the Wasserstein distance, while for multivariate distributions, we resort to the sliced Wasserstein distance. The sliced Wasserstein distance ensures that the metric space possesses similar topological properties to the Wasserstein space while also offering significant computation benefits. Numerical results based on synthetic data show that our method outperforms possible competing methods. The method is also applied to several data sets, including fertility and mortality data and Calgary temperature data.


title: Instance Shadow Detection with A Single-Stage Detector

abstract: This paper formulates a new problem, instance shadow detection, which aims to detect shadow instance and the associated object instance that cast each shadow in the input image. To approach this task, we first compile a new dataset with the masks for shadow instances, object instances, and shadow-object associations. We then design an evaluation metric for quantitative evaluation of the performance of instance shadow detection. Further, we design a single-stage detector to perform instance shadow detection in an end-to-end manner, where the bidirectional relation learning module and the deformable maskIoU head are proposed in the detector to directly learn the relation between shadow instances and object instances and to improve the accuracy of the predicted masks. Finally, we quantitatively and qualitatively evaluate our method on the benchmark dataset of instance shadow detection and show the applicability of our method on light direction estimation and photo editing.


title: Study of the process $e^+e^-\to K_S^0 K^{\pm}\pi^{\mp} \pi^+\pi^-$ in the C.M. energy range 1.6--2.0 GeV with the CMD-3 detector

abstract: The cross section of the process $e^+e^- \to K_S^0 K^{\pm}\pi^{\mp}\pi^+\pi^-$ has been measured for the first time using a data sample of 185.4 pb$^{-1}$ collected with the CMD-3 detector at the VEPP-2000 $e^+e^-$ collider. With the $K_S^0\to\pi^+\pi^-$ decay detection, 373$\pm$20 and 514$\pm$28 signal events have been selected with six and five reconstructed tracks, respectively, in the center-of-mass energy range 1.6--2.0 GeV. The total systematic uncertainty of the cross section is about 15\%. The study of the production dynamics allows us to extract contribution from the $e^+e^- \to f_1(1285)\pi^+\pi^-$ intermediate state and to measure the corresponding cross section. The intermediate states with the $f_1(1420)$ and $f_1(1510)$ resonances have been observed.


title: TNT: Vision Transformer for Turbulence Simulations

abstract: Turbulence is notoriously difficult to model due to its multi-scale nature and sensitivity to small perturbations. Classical solvers of turbulence simulation generally operate on finer grids and are computationally inefficient. In this paper, we propose the Turbulence Neural Transformer (TNT), which is a learned simulator based on the transformer architecture, to predict turbulent dynamics on coarsened grids. TNT extends the positional embeddings of vanilla transformers to a spatiotemporal setting to learn the representation in the 3D time-series domain, and applies Temporal Mutual Self-Attention (TMSA), which captures adjacent dependencies, to extract deep and dynamic features. TNT is capable of generating comparatively long-range predictions stably and accurately, and we show that TNT outperforms the state-of-the-art U-net simulator on several metrics. We also test the model performance with different components removed and evaluate robustness to different initial conditions. Although more experiments are needed, we conclude that TNT has great potential to outperform existing solvers and generalize to additional simulation datasets.


title: Experimental preparation of generalized cat states for itinerant microwave photons

abstract: Generalized cat states represent arbitrary superpositions of coherent states, which are of great importance in various quantum information processing protocols. Here we demonstrate a versatile approach to creating generalized itinerant cat states in the microwave domain, by reflecting coherent state photons from a microwave cavity containing a superconducting qubit. We show that, with a coherent control of the qubit state, a full control over the coherent state superposition can be realized. The prepared cat states are verified through quantum state tomography of the qubit state dependent reflection photon field. We further quantify quantum coherence in the prepared cat states based on the resource theory, revealing a good experimental control on the coherent state superpositions. The photon number statistic and the squeezing properties are also analyzed. Remarkably, fourth-order squeezing is observed in the experimental states. Those results open up new possibilities of applying generalized cat states for the purpose of quantum information processing.


title: Magnetic structure and spin dynamics of the quasi-2D antiferromagnet Zn-doped copper pyrovanadate

abstract: Magnetic properties of the antiferromagnet Zn$_{0.15}$Cu$_{1.85}$V$_2$O$_7$ (ZnCVO) have been thoroughly investigated on powder and single-crystal samples. The crystal structure determination using powder x-ray and neutron diffraction confirms that ZnCVO with Zn = 0.15 is isostructural with $\beta$-Cu$_{2}$V$_2$O$_7$ ($\beta$-CVO) with small deviation in the lattice parameters. Macroscopic magnetic properties measurements also confirm the similarity between the two compounds. The Cu$^{2+}$ spins were found to align along the crystallographic $c$-axis, antiparallel to their nearest neighbors connected by the leading exchange interaction $J_1$. Spin dynamics reveals a typical symmetric spin-wave dispersion with strong interactions in the $bc$-plane and weak interplane coupling. The exchange interaction analysis indicates that the spin network of ZnCVO is topologically consistent with the previous DFT prediction but the values of leading exchange interactions are contradictory. Furthermore, rather than the predicted 2D honeycomb structure, the spin network in ZnCVO could be better described by the anisotropic 2D spin network composing of $J_1$, $J_5$, and $J_6$ interactions, four bonds per one spin site, coupled by weak interplane interactions.


title: Quantifying the effects of dissipation and temperature on dynamics of a superconducting qubit-cavity system

abstract: The superconducting circuits involving Josephson junction offer macroscopic quantum two-level system (qubit) which are coupled to cavity resonators and are operated via microwave signals. In this work, we study the dynamics of superconducting qubits coupled to a cavity with including dissipation in a subkelvin temperature domain. In the first step, a classical Finite Element Method is used to simulate the cavities and basic circuit elements to model Josephson junctions. Then the quantization of the circuit is done to obtain the full Hamiltonian of the system using energy partition ratios of the junctions. Once the parameters of Hamiltonian are obtained, the dynamics is studied via Lindblad equation for an open quantum system using a realistic set of dissipative parameters and include temperature effects. Finally, we get frequency spectra and/or dynamics of the system with time which have quantum imprints. Such devices work at tens of milli Kelvins and we search for a set of parameters which could enable to observe quantum behaviour at temperatures as high as 1 K.


title: Hercules: Boosting the Performance of Privacy-preserving Federated Learning

abstract: In this paper, we address the problem of privacy-preserving federated neural network training with $N$ users. We present Hercules, an efficient and high-precision training framework that can tolerate collusion of up to $N-1$ users. Hercules follows the POSEIDON framework proposed by Sav et al. (NDSS'21), but makes a qualitative leap in performance with the following contributions: (i) we design a novel parallel homomorphic computation method for matrix operations, which enables fast Single Instruction and Multiple Data (SIMD) operations over ciphertexts. For the multiplication of two $h\times h$ dimensional matrices, our method reduces the computation complexity from $O(h^3)$ to $O(h)$. This greatly improves the training efficiency of the neural network since the ciphertext computation is dominated by the convolution operations; (ii) we present an efficient approximation on the sign function based on the composite polynomial approximation. It is used to approximate non-polynomial functions (i.e., ReLU and max), with the optimal asymptotic complexity. Extensive experiments on various benchmark datasets (BCW, ESR, CREDIT, MNIST, SVHN, CIFAR-10 and CIFAR-100) show that compared with POSEIDON, Hercules obtains up to 4% increase in model accuracy, and up to 60$\times$ reduction in the computation and communication cost.


title: Continuous-state branching processes with collisions: first passage times and duality

abstract: We introduce a class of one-dimensional positive Markov processes generalizing continuous-state branching processes (CBs), by taking into account a phenomenon of random collisions. Besides branching, characterized by a general mechanism $\Psi$, at a constant rate in time two particles are sampled uniformly in the population, collide and leave a mass of particles governed by a (sub)critical mechanism $\Sigma$. Such CB processes with collisions (CBCs) are shown to be the only Feller processes without negative jumps satisfying a Laplace duality relationship with one-dimensional diffusions on the half-line. This generalizes the duality observed for logistic CBs by Foucart. Via time-change, CBCs are also related to an auxiliary class of Markov processes, called CB processes with spectrally positive migration (CBMs), recently introduced by Vidmar. We find necessary and sufficient conditions for the boundaries $0$ or $\infty$ to be attracting and for a limiting distribution to exist. The Laplace transform of the latter is provided. Under the assumption that the CBC process does not explode, the Laplace transforms of the first passage times below arbitrary levels are represented with the help of the solution of a second-order differential equation, whose coefficients express in terms of the L\'evy-Khintchine functions $\Sigma$ and $\Psi$. Sufficient conditions for non-explosion are given.


title: Edge-preserving Near-light Photometric Stereo with Neural Surfaces

abstract: This paper presents a near-light photometric stereo method that faithfully preserves sharp depth edges in the 3D reconstruction. Unlike previous methods that rely on finite differentiation for approximating depth partial derivatives and surface normals, we introduce an analytically differentiable neural surface in near-light photometric stereo for avoiding differentiation errors at sharp depth edges, where the depth is represented as a neural function of the image coordinates. By further formulating the Lambertian albedo as a dependent variable resulting from the surface normal and depth, our method is insusceptible to inaccurate depth initialization. Experiments on both synthetic and real-world scenes demonstrate the effectiveness of our method for detailed shape recovery with edge preservation.


title: Deep neural network based adaptive learning for switched systems

abstract: In this paper, we present a deep neural network based adaptive learning (DNN-AL) approach for switched systems. Currently, deep neural network based methods are actively developed for learning governing equations in unknown dynamic systems, but their efficiency can degenerate for switching systems, where structural changes exist at discrete time instants. In this new DNN-AL strategy, observed datasets are adaptively decomposed into subsets, such that no structural changes within each subset. During the adaptive procedures, DNNs are hierarchically constructed, and unknown switching time instants are gradually identified. Especially, network parameters at previous iteration steps are reused to initialize networks for the later iteration steps, which gives efficient training procedures for the DNNs. For the DNNs obtained through our DNN-AL, bounds of the prediction error are established. Numerical studies are conducted to demonstrate the efficiency of DNN-AL.


title: Hierarchical Latent Structure for Multi-Modal Vehicle Trajectory Forecasting

abstract: Variational autoencoder (VAE) has widely been utilized for modeling data distributions because it is theoretically elegant, easy to train, and has nice manifold representations. However, when applied to image reconstruction and synthesis tasks, VAE shows the limitation that the generated sample tends to be blurry. We observe that a similar problem, in which the generated trajectory is located between adjacent lanes, often arises in VAE-based trajectory forecasting models. To mitigate this problem, we introduce a hierarchical latent structure into the VAE-based forecasting model. Based on the assumption that the trajectory distribution can be approximated as a mixture of simple distributions (or modes), the low-level latent variable is employed to model each mode of the mixture and the high-level latent variable is employed to represent the weights for the modes. To model each mode accurately, we condition the low-level latent variable using two lane-level context vectors computed in novel ways, one corresponds to vehicle-lane interaction and the other to vehicle-vehicle interaction. The context vectors are also used to model the weights via the proposed mode selection network. To evaluate our forecasting model, we use two large-scale real-world datasets. Experimental results show that our model is not only capable of generating clear multi-modal trajectory distributions but also outperforms the state-of-the-art (SOTA) models in terms of prediction accuracy. Our code is available at https://github.com/d1024choi/HLSTrajForecast.


title: FSHMEM: Supporting Partitioned Global Address Space on FPGAs for Large-Scale Hardware Acceleration Infrastructure

abstract: By providing highly efficient one-sided communication with globally shared memory space, Partitioned Global Address Space (PGAS) has become one of the most promising parallel computing models in high-performance computing (HPC). Meanwhile, FPGA is getting attention as an alternative compute platform for HPC systems with the benefit of custom computing and design flexibility. However, the exploration of PGAS has not been conducted on FPGAs, unlike the traditional message passing interface. This paper proposes FSHMEM, a software/hardware framework that enables the PGAS programming model on FPGAs. We implement the core functions of GASNet specification on FPGA for native PGAS integration in hardware, while its programming interface is designed to be highly compatible with legacy software. Our experiments show that FSHMEM achieves the peak bandwidth of 3813 MB/s, which is more than 95% of the theoretical maximum, outperforming the prior works by 9.5$\times$. It records 0.35$us$ and 0.59$us$ latency for remote write and read operations, respectively. Finally, we conduct a case study on the two Intel D5005 FPGA nodes integrating Intel's deep learning accelerator. The two-node system programmed by FSHMEM achieves 1.94$\times$ and 1.98$\times$ speedup for matrix multiplication and convolution operation, respectively, showing its scalability potential for HPC infrastructure.


title: Gallium-nitride-based interference-filter-stabilized external cavity diode laser with a surface-activated-bonded output coupler

abstract: We report on an interference-filter-stabilized external cavity diode laser using a gallium-nitride-based violet laser diode. Surface-activated-bonded glass substrates were employed as cat's eye output couplers in order to suppress power degradation due to optical damage. From the results of a long-term frequency-stabilization test, mode-hop-free operation for about one week was demonstrated. After a continuous operation of about three weeks, the power degradation was less than 10$\%$. The results show the potential of such interference-filter-stabilized external cavity diode lasers for practical and portable quantum technologies such as atomic clocks or atomic interferometers.


title: Angehrn-Siu-Helmke's method applied to abelian varieties

abstract: We apply Angehrn-Siu-Helmke's method to estimate basepoint freeness thresholds of higher dimensional polarized abelian varieties. We showed that a conjecture of Caucci holds for very general polarized abelian varieties in the moduli spaces $\mathcal A_{g, l}$ with only finitely many possible exceptions of polarization types $l$ in each dimension $g$. We improved the bound of basepoint freeness thresholds of any polarized ableian $4$-folds and simple abelian $5$-folds.


title: Dense real Rel flow orbits and absolute period leaves

abstract: We show the existence of a dense orbit for real Rel flows on the area-1 locus of every connected component of every stratum of holomorphic 1-forms with at least 2 distinct zeros. For this purpose, we establish a general density criterion for ${\rm SL}(2,\mathbb{R})$-orbit closures, based on finding an orbit of a real Rel flow whose closure contains a horocycle. This criterion can be verified using explicit constructions of holomorphic 1-forms with a periodic horizontal foliation. Our constructions also provide explicit examples of dense leaves of the absolute period foliation and many subfoliations of these loci.


title: On the eigenvalues of the graphs $D(5, q)$

abstract: Let $q = p^e$, where $p$ is a prime and $e$ is a positive integer. The family of graphs $D(k, q)$, defined for any positive integer $k$ and prime power $q$, were introduced by Lazebnik and Ustimenko in 1995. To this day, the connected components of the graphs $D(k, q)$, provide the best known general lower bound for the size of a graph of given order and given girth. Furthermore, Ustimenko conjectured that the second largest eigenvalue of $D(k, q)$ is always less than or equal to $2\sqrt{q}$. If true, this would imply that for a fixed $q$ and $k$ growing, $D(k, q)$ would define a family of expanders that are nearly Ramanujan. In this paper we prove the smallest open case of the conjecture, showing that for all odd prime powers $q$, the second largest eigenvalue of $D(5, q)$ is less than or equal to $2\sqrt{q}$.


title: On the Principles of Parsimony and Self-Consistency for the Emergence of Intelligence

abstract: Ten years into the revival of deep networks and artificial intelligence, we propose a theoretical framework that sheds light on understanding deep networks within a bigger picture of Intelligence in general. We introduce two fundamental principles, Parsimony and Self-consistency, that address two fundamental questions regarding Intelligence: what to learn and how to learn, respectively. We believe the two principles are the cornerstones for the emergence of Intelligence, artificial or natural. While these two principles have rich classical roots, we argue that they can be stated anew in entirely measurable and computable ways. More specifically, the two principles lead to an effective and efficient computational framework, compressive closed-loop transcription, that unifies and explains the evolution of modern deep networks and many artificial intelligence practices. While we mainly use modeling of visual data as an example, we believe the two principles will unify understanding of broad families of autonomous intelligent systems and provide a framework for understanding the brain.


title: Partial Resampling of Imbalanced Data

abstract: Imbalanced data is a frequently encountered problem in machine learning. Despite a vast amount of literature on sampling techniques for imbalanced data, there is a limited number of studies that address the issue of the optimal sampling ratio. In this paper, we attempt to fill the gap in the literature by conducting a large scale study of the effects of sampling ratio on classification accuracy. We consider 10 popular sampling methods and evaluate their performance over a range of ratios based on 20 datasets. The results of the numerical experiments suggest that the optimal sampling ratio is between 0.7 and 0.8 albeit the exact ratio varies depending on the dataset. Furthermore, we find that while factors such the original imbalance ratio or the number of features do not play a discernible role in determining the optimal ratio, the number of samples in the dataset may have a tangible effect.


title: SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled Codebooks

abstract: We present SkexGen, a novel autoregressive generative model for computer-aided design (CAD) construction sequences containing sketch-and-extrude modeling operations. Our model utilizes distinct Transformer architectures to encode topological, geometric, and extrusion variations of construction sequences into disentangled codebooks. Autoregressive Transformer decoders generate CAD construction sequences sharing certain properties specified by the codebook vectors. Extensive experiments demonstrate that our disentangled codebook representation generates diverse and high-quality CAD models, enhances user control, and enables efficient exploration of the design space. The code is available at https://samxuxiang.github.io/skexgen.


title: Spectroscopic imaging ellipsometry of two-dimensional TMDC heterostructures

abstract: Semiconducting two-dimensional materials and their heterostructures gained a lot of interest for applications as well as fundamental studies due to their rich optical properties. Assembly in van der Waals heterostacks can significantly alter the intrinsic optical properties as well as the wavelength-dependent absorption and emission efficiencies making a direct comparison of e.g. photoluminescence intensities difficult. Here, we determine the dielectric function for the prototypical MoSe2/WSe2 heterobilayer and their individual layers. Apart from a redshift of 18 meV - 44 meV of the energetically lowest interband transitions, we find that for larger energies the dielectric function can only be described by treating the van der Waals heterobilayer as a new artificial homobilayer crystal rather than a stack of individual layers. The determined dielectric functions are applied to calculate the Michelson contrast of the individual layers and the bilayer in dependence of the oxide thickness of often used Si/SiO2 substrates. Our results highlight the need to consider the altered dielectric functions impacting the Michelson interference in the interpretation of intensities in optical measurements such as Raman scattering or photoluminescence.


title: $^7$H ground state as a $^3$H+4n resonance

abstract: We have investigated the possible existence of a $^7$H resonant state, considered as a five-body system consisting of a $^3$H core with four valence neutrons. To this aim, an effective n-$^3$H potential is constructed in order to reproduce the low energy elastic neutron scattering on $^3$H phase shifts and the $^5$H resonant ground state in terms of $^3$H-n-n system. The variational Gaussian Expansion Method is used to solve the 5-body Schr\"{o}dinger equation, while the resonant state parameters were estimated by means of the stabilization method. We have not found any sign of a narrow low energy resonance in the vicinity of $^3$H+4n threshold. However, we have identified a very broad structure at $E_R\approx 9$ MeV above this threshold, which corresponds to the $^7$H J$^{\pi}$=1/2$^+$ ground state. In the vicinity of this state, we have also identified a broad structure corresponding to the ground state of $^6$H isotope with quantum numbers $J^{\pi}=2^-$.


title: Optimal Storage and Solar Capacity of a Residential Household under Net Metering and Time-of-Use Pricing

abstract: Incentive programs and ongoing reduction in costs are driving joint installation of solar PV panels and storage systems in residential households. There is a need for optimal investment decisions to reduce the electricity consumption costs of the households further. In this paper, we first develop analytical expression of storage investment decision and then of solar investment decision for a household which is under net metering billing mechanism with time of use pricing condition. Using real data of a residential household in Austin, TX, USA, we study how the investment decisions would provide benefit for a period of one year. Results show significant profit when using storage devices and solar panels optimally for the system. It is important to note that though our approach can help significantly to take investment decisions, the solution will still be sub-optimal for somebody who needs optimal investment jointly on both storage and solar systems.


title: Fast exchange with Gaussian basis set using robust pseudospectral method

abstract: In this article we present an algorithm to efficiently evaluate the exchange matrix in periodic systems when Gaussian basis set with pseudopotentials are used. The usual algorithm for evaluating exchange matrix scales cubically with the system size because one has to perform O(N2) fast Fourier transforms (FFT). Here we introduce an algorithm that retains the cubic scaling but reduces the prefactor significantly by eliminating the need to do FFTs during each exchange build. This is accomplished by representing the products of Gaussian basis function using a linear combination of an auxiliary basis the number of which scales linearly with the size of the system. We store the potential due to these auxiliary functions in memory which allows us to obtain the exchange matrix without the need to do FFT, albeit at the cost of additional memory requirement. Although the basic idea of using auxiliary functions is not new, our algorithm is cheaper due to a combination of three ingredients: (a) we use robust Pseudospectral method that allows us to use a relatively small number of auxiliary basis to obtain high accuracy (b) we use occ-RI exchange which eliminates the need to construct the full exchange matrix and (c) we use the (interpolative separable density fitting) ISDF algorithm to construct these auxiliary basis that are used in the robust pseudospectral method. The resulting algorithm is accurate and we note that the error in the final energy decreases exponentially rapidly with the number of auxiliary functions.


title: SIMC 2.0: Improved Secure ML Inference Against Malicious Clients

abstract: In this paper, we study the problem of secure ML inference against a malicious client and a semi-trusted server such that the client only learns the inference output while the server learns nothing. This problem is first formulated by Lehmkuhl \textit{et al.} with a solution (MUSE, Usenix Security'21), whose performance is then substantially improved by Chandran et al.'s work (SIMC, USENIX Security'22). However, there still exists a nontrivial gap in these efforts towards practicality, giving the challenges of overhead reduction and secure inference acceleration in an all-round way. We propose SIMC 2.0, which complies with the underlying structure of SIMC, but significantly optimizes both the linear and non-linear layers of the model. Specifically, (1) we design a new coding method for homomorphic parallel computation between matrices and vectors. It is custom-built through the insight into the complementarity between cryptographic primitives in SIMC. As a result, it can minimize the number of rotation operations incurred in the calculation process, which is very computationally expensive compared to other homomorphic operations e.g., addition, multiplication). (2) We reduce the size of the garbled circuit (GC) (used to calculate nonlinear activation functions, e.g., ReLU) in SIMC by about two thirds. Then, we design an alternative lightweight protocol to perform tasks that are originally allocated to the expensive GCs. Compared with SIMC, our experiments show that SIMC 2.0 achieves a significant speedup by up to $17.4\times $ for linear layer computation, and at least $1.3\times$ reduction of both the computation and communication overheads in the implementation of non-linear layers under different data dimensions. Meanwhile, SIMC 2.0 demonstrates an encouraging runtime boost by $2.3\sim 4.3\times$ over SIMC on different state-of-the-art ML models.


title: Learning Closed-loop Dough Manipulation Using a Differentiable Reset Module

abstract: Deformable object manipulation has many applications such as cooking and laundry folding in our daily lives. Manipulating elastoplastic objects such as dough is particularly challenging because dough lacks a compact state representation and requires contact-rich interactions. We consider the task of flattening a piece of dough into a specific shape from RGB-D images. While the task is seemingly intuitive for humans, there exist local optima for common approaches such as naive trajectory optimization. We propose a novel trajectory optimizer that optimizes through a differentiable "reset" module, transforming a single-stage, fixed-initialization trajectory into a multistage, multi-initialization trajectory where all stages are optimized jointly. We then train a closed-loop policy on the demonstrations generated by our trajectory optimizer. Our policy receives partial point clouds as input, allowing ease of transfer from simulation to the real world. We show that our policy can perform real-world dough manipulation, flattening a ball of dough into a target shape.


title: A Dual-Polarization Information Guided Network for SAR Ship Classification

abstract: How to fully utilize polarization to enhance synthetic aperture radar (SAR) ship classification remains an unresolved issue. Thus, we propose a dual-polarization information guided network (DPIG-Net) to solve it.


title: A geometric speed limit for acceleration by natural selection in evolutionary processes

abstract: We derived a new speed limit in population dynamics, which is a fundamental limit on the evolutionary rate. By splitting the contributions of selection and mutation to the evolutionary rate, we obtained the new bound on the speed of arbitrary observables, named the selection bound, that can be tighter than the conventional Cram\'{e}r--Rao bound. Remarkably, the selection bound can be much tighter if the contribution of selection is more dominant than that of mutation. This tightness can be geometrically characterized by the correlation between the observable of interest and the growth rate. We also numerically illustrate the effectiveness of the selection bound in the transient dynamics of evolutionary processes and discuss how to test our speed limit experimentally.


title: The complement of enhanced power graph of a finite group

abstract: The enhanced power graph $\mathcal{P}_E(G)$ of a finite group $G$ is the simple undirected graph whose vertex set is $G$ and two distinct vertices $x, y$ are adjacent if $x, y \in \langle z \rangle$ for some $z \in G$. In this article, we give an affirmative answer of the question posed by Cameron [6] which states that: Is it true that the complement of the enhanced power graph $\bar{\mathcal{P}_E(G)}$ of a non-cyclic group $G$ has only one connected component apart from isolated vertices? We classify all finite groups $G$ such that the graph $\bar{\mathcal{P}_E(G)}$ is bipartite. We show that the graph $\bar{\mathcal{P}_E(G)}$ is weakly perfect. Further, we study the subgraph $\bar{\mathcal{P}_E(G^*)}$ of $\bar{\mathcal{P}_E(G)}$ induced by all the non-isolated vertices of $\bar{\mathcal{P}_E(G)}$. We classify all finite groups $G$ such that the graph is $\bar{\mathcal{P}_E(G^*)}$ is unicyclic and pentacyclic. We prove the non-existence of finite groups $G$ such that the graph $\bar{\mathcal{P}_E(G^*)}$ is bicyclic, tricyclic or tetracyclic. Finally, we characterize all finite groups $G$ such that the graph $\bar{\mathcal{P}_E(G^*)}$ is outerplanar, planar, projective-planar and toroidal, respectively.


title: On the cohomology based on the generalized representations of $n$-Lie Algebras

abstract: In the present paper, we define the new class of representation on $n$-Lie algebra that is called as generalized representation. We study the cohomology theory corresponding to generalized representations of $n$-Lie algebras and show its relation with the cohomology corresponding to the usual representations. Furthermore, we provide the computation for the low dimensional cocycles.


title: The Structure of Fluctuating Thin Sheets Under Random Forcing

abstract: We propose a mathematical model to describe the athermal fluctuations of thin sheets driven by the type of random driving that might be experienced prior to weak crumpling. The model is obtained by merging the F\"oppl-von K\'arm\'an equations from elasticity theory with techniques from out-of-equilibrium statistical physics to obtain a nonlinear strongly coupled $\phi^{4}$-Langevin field equation with spatially varying kernel. With the aid of the self-consistent expansion (SCE), this equation is analytically solved for the structure factor of a fluctuating sheet. In contrast to previous research which has suggested that the structure factor follows an anomalous power-law, we find that the structure factor in fact obeys a logarithmically corrected rational function. Numerical simulations of our model confirm the accuracy of our analytical solution.


title: Mock theta functions and characters of N=3 superconformal modules III

abstract: In this paper we study the branching functions of tensor products of N=3 superconformal modules.


title: Single Mode Multi-frequency Factorization Method for the Inverse Source Problem in Acoustic Waveguides

abstract: This paper investigates the inverse source problem with a single propagating mode at multiple frequencies in an acoustic waveguide. The goal is to provide both theoretical justifications and efficient algorithms for imaging extended sources using the sampling methods. In contrast to the existing far/near field operator based on the integral over the space variable in the sampling methods, a multi-frequency far-field operator is introduced based on the integral over the frequency variable. This far-field operator is defined in a way to incorporate the possibly non-linear dispersion relation, a unique feature in waveguides. The factorization method is deployed to establish a rigorous characterization of the range support which is the support of source in the direction of wave propagation. A related factorization-based sampling method is also discussed. These sampling methods are shown to be capable of imaging the range support of the source. Numerical examples are provided to illustrate the performance of the sampling methods, including an example to image a complete sound-soft block.


title: DelightfulTTS 2: End-to-End Speech Synthesis with Adversarial Vector-Quantized Auto-Encoders

abstract: Current text to speech (TTS) systems usually leverage a cascaded acoustic model and vocoder pipeline with mel-spectrograms as the intermediate representations, which suffer from two limitations: 1) the acoustic model and vocoder are separately trained instead of jointly optimized, which incurs cascaded errors; 2) the intermediate speech representations (e.g., mel-spectrogram) are pre-designed and lose phase information, which are sub-optimal. To solve these problems, in this paper, we develop DelightfulTTS 2, a new end-to-end speech synthesis system with automatically learned speech representations and jointly optimized acoustic model and vocoder. Specifically, 1) we propose a new codec network based on vector-quantized auto-encoders with adversarial training (VQ-GAN) to extract intermediate frame-level speech representations (instead of traditional representations like mel-spectrograms) and reconstruct speech waveform; 2) we jointly optimize the acoustic model (based on DelightfulTTS) and the vocoder (the decoder of VQ-GAN), with an auxiliary loss on the acoustic model to predict intermediate speech representations. Experiments show that DelightfulTTS 2 achieves a CMOS gain +0.14 over DelightfulTTS, and more method analyses further verify the effectiveness of the developed system.


title: Epi-constructivism: Decidable sets of computable numbers as foundational objects for mathematics

abstract: It is well known that the R, the set of real numbers, is an abstract set, where almost all its elements cannot be described in any finite language. We investigate possible approaches to what might be called an epi-constructionist approach to mathematics. While most constructive mathematics is concerned with constructive proofs, the agenda here is that the objects that we study, specifically the class of numbers that we study, should be an enumerable set of finite symbol strings. These might also be called decidable constructive real numbers, that is our class of numbers should be a computable sets of explicitly represented computable numbers. There have been various investigations of the computable numbers going back to Turing. Most are however not expressed constructively, rather computable is a property assigned to some of the abstract real numbers. Other definitions define constructive real numbers without reference to the abstract R, but the construction is undecidable, i.e., we cannot determine if a given construction represents a computable real number or not. For example, we may define a real as a computable convergent sequence of rationals, but cannot in general decide if a given computable sequence is convergent. This paper explores several specific classes of decidable constructive real numbers that could form foundational objects for what we might call an epi-constructionist mathematics.


title: Learning Large-scale Universal User Representation with Sparse Mixture of Experts

abstract: Learning user sequence behaviour embedding is very sophisticated and challenging due to the complicated feature interactions over time and high dimensions of user features. Recent emerging foundation models, e.g., BERT and its variants, encourage a large body of researchers to investigate in this field. However, unlike natural language processing (NLP) tasks, the parameters of user behaviour model come mostly from user embedding layer, which makes most existing works fail in training a universal user embedding of large scale. Furthermore, user representations are learned from multiple downstream tasks, and the past research work do not address the seesaw phenomenon. In this paper, we propose SUPERMOE, a generic framework to obtain high quality user representation from multiple tasks. Specifically, the user behaviour sequences are encoded by MoE transformer, and we can thus increase the model capacity to billions of parameters, or even to trillions of parameters. In order to deal with seesaw phenomenon when learning across multiple tasks, we design a new loss function with task indicators. We perform extensive offline experiments on public datasets and online experiments on private real-world business scenarios. Our approach achieves the best performance over state-of-the-art models, and the results demonstrate the effectiveness of our framework.


title: Fast Density-Peaks Clustering: Multicore-based Parallelization Approach

abstract: Clustering multi-dimensional points is a fundamental task in many fields, and density-based clustering supports many applications as it can discover clusters of arbitrary shapes. This paper addresses the problem of Density-Peaks Clustering (DPC), a recently proposed density-based clustering framework. Although DPC already has many applications, its straightforward implementation incurs a quadratic time computation to the number of points in a given dataset, thereby does not scale to large datasets. To enable DPC on large datasets, we propose efficient algorithms for DPC. Specifically, we propose an exact algorithm, Ex-DPC, and two approximation algorithms, Approx-DPC and S-Approx-DPC. Under a reasonable assumption about a DPC parameter, our algorithms are sub-quadratic, i.e., break the quadratic barrier. Besides, Approx-DPC does not require any additional parameters and can return the same cluster centers as those of Ex-DPC, rendering an accurate clustering result. S-Approx-DPC requires an approximation parameter but can speed up its computational efficiency. We further present that their efficiencies can be accelerated by leveraging multicore processing. We conduct extensive experiments using synthetic and real datasets, and our experimental results demonstrate that our algorithms are efficient, scalable, and accurate.


title: A blended distance to define "people-like-me"

abstract: Curve matching is a prediction technique that relies on predictive mean matching, which matches donors that are most similar to a target based on the predictive distance. Even though this approach leads to high prediction accuracy, the predictive distance may make matches look unconvincing, as the profiles of the matched donors can substantially differ from the profile of the target. To counterbalance this, similarity between the curves of the donors and the target can be taken into account by combining the predictive distance with the Mahalanobis distance into a `blended distance' measure. The properties of this measure are evaluated in two simulation studies. Simulation study I evaluates the performance of the blended distance under different data-generating conditions. The results show that blending towards the Mahalanobis distance leads to worse performance in terms of bias, coverage, and predictive power. Simulation study II evaluates the blended metric in a setting where a single value is imputed. The results show that a property of blending is the bias-variance trade off. Giving more weight to the Mahalanobis distance leads to less variance in the imputations, but less accuracy as well. The main conclusion is that the high prediction accuracy achieved with the predictive distance necessitates the variability in the profiles of donors.


title: A Lexicon and Depth-wise Separable Convolution Based Handwritten Text Recognition System

abstract: Cursive handwritten text recognition is a challenging research problem in the domain of pattern recognition. The current state-of-the-art approaches include models based on convolutional recurrent neural networks and multi-dimensional long short-term memory recurrent neural networks techniques. These methods are highly computationally extensive as well model is complex at design level. In recent studies, combination of convolutional neural network and gated convolutional neural networks based models demonstrated less number of parameters in comparison to convolutional recurrent neural networks based models. In the direction to reduced the total number of parameters to be trained, in this work, we have used depthwise convolution in place of standard convolutions with a combination of gated-convolutional neural network and bidirectional gated recurrent unit to reduce the total number of parameters to be trained. Additionally, we have also included a lexicon based word beam search decoder at testing step. It also helps in improving the the overall accuracy of the model. We have obtained 3.84% character error rate and 9.40% word error rate on IAM dataset; 4.88% character error rate and 14.56% word error rate in George Washington dataset, respectively.