title: Transport spectroscopy of ultraclean tunable band gaps in bilayer graphene

abstract: The importance of controlling both the charge carrier density and the band gap of a semiconductor cannot be overstated, as it opens the doors to a wide range of applications, including, e.g., highly-tunable transistors, photodetectors, and lasers. Bernal-stacked bilayer graphene is a unique van-der-Waals material that allows tuning the band gap by an out-of-plane electric field. Although the first evidence of the tunable gap was already found ten years ago, it took until recent to fabricate sufficiently clean heterostructures where the electrically induced gap could be used to fully suppress transport or confine charge carriers. Here, we present a detailed study of the tunable band gap in gated bilayer graphene characterized by temperature-activated transport and finite-bias spectroscopy measurements. The latter method allows comparing different gate materials and device technologies, which directly affects the disorder potential in bilayer graphene. We show that graphite-gated bilayer graphene exhibits extremely low disorder and as good as no subgap states resulting in ultraclean tunable band gaps up to 120 meV. The size of the band gaps are in good agreement with theory and allow complete current suppression making a wide range of semiconductor applications possible.


title: When Personalization Harms: Reconsidering the Use of Group Attributes in Prediction

abstract: Machine learning models are often personalized with categorical attributes that are protected, sensitive, self-reported, or costly to acquire. In this work, we show models that are personalized with group attributes can reduce performance at a group level. We propose formal conditions to ensure the "fair use" of group attributes in prediction tasks by training one additional model -- i.e., collective preference guarantees to ensure that each group who provides personal data will receive a tailored gain in performance in return. We present sufficient conditions to ensure fair use in empirical risk minimization and characterize failure modes that lead to fair use violations due to standard practices in model development and deployment. We present a comprehensive empirical study of fair use in clinical prediction tasks. Our results demonstrate the prevalence of fair use violations in practice and illustrate simple interventions to mitigate their harm.


title: Empowering GNNs via Edge-Aware Weisfeiler-Leman Algorithm

abstract: Message passing graph neural networks (GNNs) are known to have their expressiveness upper-bounded by 1-dimensional Weisfeiler-Leman (1-WL) algorithm. To achieve more powerful GNNs, existing attempts either require ad hoc features, or involve operations that incur high time and space complexities. In this work, we propose a general and provably powerful GNN framework that preserves the scalability of the message passing scheme. In particular, we first propose to empower 1-WL for graph isomorphism test by considering edges among neighbors, giving rise to NC-1-WL. The expressiveness of NC-1-WL is shown to be strictly above 1-WL and below 3-WL theoretically. Further, we propose the NC-GNN framework as a differentiable neural version of NC-1-WL. Our simple implementation of NC-GNN is provably as powerful as NC-1-WL. Experiments demonstrate that our NC-GNN performs effectively and efficiently on various benchmarks.


title: A privacy preserving querying mechanism with high utility for electric vehicles

abstract: Electric vehicles (EVs) are gaining popularity due to the growing awareness for a sustainable future. However, since there are disproportionately fewer charging stations than EVs, range anxiety plays a major role in the rise in the number of queries made along the journeys to find an available charging station. On the other hand, the use of personal data in various types of analytics is increasing at an unprecedented rate. Hence, the risks of privacy violation are also surging. Geo-indistinguishability is one of the standards for formalising location privacy as a generalisation of the local differential privacy. However, the noise has to be carefully calibrated considering the implications of potential utility-loss. In this paper, we introduce approximate geo-indistinguishability (AGeoI) which allows the EVs to obfuscate the individual query-locations while ensuring that they remain within their preferred area of interest. It is vital because journeys are often sensitive to a sharp drop in QoS, which has a high cost for the extra distance to be covered. We apply AGeoI and dummy data generation to protect the privacy of EVs during their journeys and preserve the QoS. Analytical insights and experiments are used to demonstrate that a very high percentage of EVs get privacy for free and that the utility-loss caused by the privacy-gain is minuscule. Using the iterative Bayesian update, our method allows for a private and highly accurate prediction of charging station occupancy without disclosing query locations and vehicle trajectories, which is vital in unprecedented traffic congestion scenarios and efficient route-planning.


title: Low Power Neuromorphic EMG Gesture Classification

abstract: EMG (Electromyograph) signal based gesture recognition can prove vital for applications such as smart wearables and bio-medical neuro-prosthetic control. Spiking Neural Networks (SNNs) are promising for low-power, real-time EMG gesture recognition, owing to their inherent spike/event driven spatio-temporal dynamics. In literature, there are limited demonstrations of neuromorphic hardware implementation (at full chip/board/system scale) for EMG gesture classification. Moreover, most literature attempts exploit primitive SNNs based on LIF (Leaky Integrate and Fire) neurons. In this work, we address the aforementioned gaps with following key contributions: (1) Low-power, high accuracy demonstration of EMG-signal based gesture recognition using neuromorphic Recurrent Spiking Neural Networks (RSNN). In particular, we propose a multi-time scale recurrent neuromorphic system based on special double-exponential adaptive threshold (DEXAT) neurons. Our network achieves state-of-the-art classification accuracy (90%) while using ~53% lesser neurons than best reported prior art on Roshambo EMG dataset. (2) A new multi-channel spike encoder scheme for efficient processing of real-valued EMG data on neuromorphic systems. (3) Unique multi-compartment methodology to implement complex adaptive neurons on Intel's dedicated neuromorphic Loihi chip is shown. (4) RSNN implementation on Loihi (Nahuku 32) achieves significant energy/latency benefits of ~983X/19X compared to GPU for batch size as 50.


title: Performance Analysis of SPAD-Based Optical Wireless Communication with OFDM

abstract: In recent years, there has been a growing interest in the use of single-photon avalanche diode (SPAD) in optical wireless communication (OWC). SPAD operates in the Geiger mode and can act as a photon counting receiver obviating the need for a transimpedance amplifier (TIA). Although a SPAD receiver can provide higher sensitivity compared to the traditional linear photodetectors, it suffers from the dead-time-induced nonlinearity. To improve the data rates of SPAD-based OWC systems, optical orthogonal frequency division multiplexing (OFDM) can be employed. This paper provides a comprehensive theoretical analysis of the SPAD-based OWC systems using OFDM signalling considering the effects of signal clipping, SPAD nonlinearity, and signal-dependent shot noise. An equivalent additive Gaussian noise channel model is proposed to describe the performance of the SPAD-based OFDM system. The statistics of the proposed channel model and the analytical expressions of the signal-to-noise ratio (SNR) and bit error rate (BER) are derived in closed forms. By means of extensive numerical results, the impact of the unique receiver nonlinearity on the system performance is investigated. The results demonstrate new insights into different optical power regimes of reliable operation for SPAD-based OFDM systems even well beyond SPAD saturation level.


title: Active Bayesian Causal Inference

abstract: Causal discovery and causal reasoning are classically treated as separate and consecutive tasks: one first infers the causal graph, and then uses it to estimate causal effects of interventions. However, such a two-stage approach is uneconomical, especially in terms of actively collected interventional data, since the causal query of interest may not require a fully-specified causal model. From a Bayesian perspective, it is also unnatural, since a causal query (e.g., the causal graph or some causal effect) can be viewed as a latent quantity subject to posterior inference -- other unobserved quantities that are not of direct interest (e.g., the full causal model) ought to be marginalized out in this process and contribute to our epistemic uncertainty. In this work, we propose Active Bayesian Causal Inference (ABCI), a fully-Bayesian active learning framework for integrated causal discovery and reasoning, which jointly infers a posterior over causal models and queries of interest. In our approach to ABCI, we focus on the class of causally-sufficient, nonlinear additive noise models, which we model using Gaussian processes. We sequentially design experiments that are maximally informative about our target causal query, collect the corresponding interventional data, and update our beliefs to choose the next experiment. Through simulations, we demonstrate that our approach is more data-efficient than several baselines that only focus on learning the full causal graph. This allows us to accurately learn downstream causal queries from fewer samples while providing well-calibrated uncertainty estimates for the quantities of interest.


title: The Thermodynamic Cost of Erasing Information in Finite-time

abstract: The Landauer principle sets a fundamental thermodynamic constraint on the minimum amount of heat that must be dissipated to erase one logical bit of information through a quasi-statically slow protocol. For finite time information erasure, the thermodynamic costs depend on the specific physical realization of the logical memory and how the information is erased. Here we treat the problem within the paradigm of a Brownian particle in a symmetric double-well potential. The two minima represent the two values of a logical bit, 0 and 1, and the particle's position is the current state of the memory. The erasure protocol is realized by applying an external time-dependent tilting force. We derive analytical tools to evaluate the work required to erase a classical bit of information in finite time via an arbitrary continuous erasure protocol, which is a relevant setting for practical applications. Importantly, our method is not restricted to the average work, but instead gives access to the full work distribution arising from many independent realizations of the erasure process. Using the common example of an erasure protocol that changes linearly with time acting on a double-parabolic potential, we explicitly calculate all relevant quantities and verify them numerically.


title: Quasisymmetric harmonics of the exterior algebra

abstract: We study the ring of quasisymmetric polynomials in $n$ anticommuting (fermionic) variables. Let $R_n$ denote the polynomials in $n$ anticommuting variables. The main results of this paper show the following interesting facts about quasisymmetric polynomials in anticommuting variables: (1) The quasisymmetric polynomials in $R_n$ form a commutative sub-algebra of $R_n$. (2) There is a basis of the quotient of $R_n$ by the ideal $I_n$ generated by the quasisymmetric polynomials in $R_n$ that is indexed by ballot sequences. The Hilbert series of the quotient is given by $$ \text{Hilb}_{R_n/I_n}(q) = \sum_{k=0}^{\lfloor{n/2}\rfloor} f^{(n-k,k)} q^k\,,$$ where $f^{(n-k,k)}$ is the number of standard tableaux of shape $(n-k,k)$. (3) There is a basis of the ideal generated by quasisymmetric polynomials that is indexed by sequences that break the ballot condition


title: PIDNet: A Real-time Semantic Segmentation Network Inspired by PID Controllers

abstract: Two-branch network architecture has shown its efficiency and effectiveness in real-time semantic segmentation tasks. However, direct fusion of high-resolution details and low-frequency context has the drawback of detailed features being easily overwhelmed by surrounding contextual information. This overshoot phenomenon limits the improvement of the segmentation accuracy of existing two-branch models. In this paper, we make a connection between Convolutional Neural Networks (CNN) and Proportional-Integral-Derivative (PID) controllers and reveal that a two-branch network is equivalent to a Proportional-Integral (PI) controller, which inherently suffers from similar overshoot issues. To alleviate this problem, we propose a novel three-branch network architecture: PIDNet, which contains three branches to parse detailed, context and boundary information, respectively, and employs boundary attention to guide the fusion of detailed and context branches. Our family of PIDNets achieve the best trade-off between inference speed and accuracy and their accuracy surpasses all the existing models with similar inference speed on the Cityscapes and CamVid datasets. Specifically, PIDNet-S achieves 78.6% mIOU with inference speed of 93.2 FPS on Cityscapes and 80.1% mIOU with speed of 153.7 FPS on CamVid.


title: Learning Robust Representations Of Generative Models Using Set-Based Artificial Fingerprints

abstract: With recent progress in deep generative models, the problem of identifying synthetic data and comparing their underlying generative processes has become an imperative task for various reasons, including fighting visual misinformation and source attribution. Existing methods often approximate the distance between the models via their sample distributions. In this paper, we approach the problem of fingerprinting generative models by learning representations that encode the residual artifacts left by the generative models as unique signals that identify the source models. We consider these unique traces (a.k.a. "artificial fingerprints") as representations of generative models, and demonstrate their usefulness in both the discriminative task of source attribution and the unsupervised task of defining a similarity between the underlying models. We first extend the existing studies on fingerprints of GANs to four representative classes of generative models (VAEs, Flows, GANs and score-based models), and demonstrate their existence and attributability. We then improve the stability and attributability of the fingerprints by proposing a new learning method based on set-encoding and contrastive training. Our set-encoder, unlike existing methods that operate on individual images, learns fingerprints from a \textit{set} of images. We demonstrate improvements in the stability and attributability through comparisons to state-of-the-art fingerprint methods and ablation studies. Further, our method employs contrastive training to learn an implicit similarity between models. We discover latent families of generative models using this metric in a standard hierarchical clustering algorithm.


title: A Further Look at the Bayes Blind Spot

abstract: Gyenis and Redei have demonstrated that any prior p on a finite algebra, however chosen, severely restricts the set of posteriors accessible from p by Jeffrey conditioning on a nontrivial partition. Their demonstration involves showing that the set of posteriors not accessible from p in this way (which they call the Bayes blind spot of p) is large with respect to three common measures of size, namely, having cardinality c, (normalized) Lebesgue measure 1, and Baire second category with respect to a natural topology. In the present paper, we establish analogous results for probability measures defined on any infinite sigma algebra of subsets of a denumerably infinite set. However, we have needed to employ distinctly different approaches to determine the cardinality, and especially, the topological and measure-theoretic sizes of the Bayes blind spot in the infinite case. Interestingly, all of the results that we establish for a single prior p continue to hold for the intersection of the Bayes blind spots of countably many priors. This leads us to conjecture that Bayesian learning itself might be just as culpable as the limitations imposed by priors in enabling the existence of large Bayes blind spots.


title: Only what exists can cause: An intrinsic view of free will

abstract: This essay addresses the implications of integrated information theory (IIT) for free will. IIT is a theory of what consciousness is and what it takes to have it. According to IIT, the presence of consciousness is accounted for by a maximum of cause-effect power in the brain. Moreover, the way specific experiences feel is accounted for by how that cause-effect power is structured. If IIT is right, we do have free will in the fundamental sense: we have true alternatives, we make true decisions, and we - not our neurons or atoms - are the true cause of our willed actions and bear true responsibility for them. IIT's argument for true free will hinges on the proper understanding of consciousness as true existence, as captured by its intrinsic powers ontology: what truly exists, in physical terms, are intrinsic entities, and only what truly exists can cause.


title: Priors in Deep Image Restoration and Enhancement: A Survey

abstract: Image restoration and enhancement is a process of improving the image quality by removing degradations, such as noise, blur, and resolution degradation. Deep learning (DL) has recently been applied to image restoration and enhancement. Due to its ill-posed property, plenty of works have been explored priors to facilitate training deep neural networks (DNNs). However, the importance of priors has not been systematically studied and analyzed by far in the research community. Therefore, this paper serves as the first study that provides a comprehensive overview of recent advancements in priors for deep image restoration and enhancement. Our work covers five primary contents: (1) A theoretical analysis of priors for deep image restoration and enhancement; (2) A hierarchical and structural taxonomy of priors commonly used in the DL-based methods; (3) An insightful discussion on each prior regarding its principle, potential, and applications; (4) A summary of crucial problems by highlighting the potential future directions, especially adopting the large-scale foundation models as prior, to spark more research in the community; (5) An open-source repository that provides a taxonomy of all mentioned works and code links.


title: Transit least-squares survey IV. Earth-like transiting planets expected from the PLATO mission

abstract: In its long-duration observation phase, the PLATO satellite will observe two non-overlapping fields for a total of 4 yr. The exact duration of each pointing will be determined 2 yr before launch. Previous estimates of PLATO's yield of Earth-sized planets in the habitable zones (HZs) around solar-type stars ranged between 6 and 280. We use the PLATO Solar-like Light curve Simulator (PSLS) to simulate light curves with transiting planets around bright (m_V > 11) Sun-like stars at a cadence of 25 s, roughly representative of the >15,000 targets in PLATO's high-priority P1 sample (mostly F5-K7 dwarfs and sub-dwarfs). Our study includes light curves generated from synchronous observations of 6, 12, 18, and 24 of PLATO's 12 cm aperture cameras over both 2 yr and 3 yr of continuous observations. Automated detrending is done with the Wotan software and post-detrending transit detection is performed with the Transit Least Squares (TLS) algorithm. We scale the true positive rates (TPRs) with the expected number of stars in the P1 sample and with modern estimates of the exoplanet occurrence rates and predict the detection of planets with 0.5 R_E <= R_p <= 1.5 R_E in the HZs around F5-K7 dwarf stars. For the (2 yr + 2 yr) long-duration observation phase strategy we predict 11-34 detections, for the (3 yr + 1 yr) strategy we predict 8-25 discoveries. Our study of the effects of stellar variability on shallow transits of Earth-like planets illustrates that our estimates of PLATO's planet yield, which we derive using a photometrically quiet star like the Sun, must be seen as upper limits. In conclusion, PLATO's detection of about a dozen Earth-sized planets in the HZs around solar-type stars will mean a major contribution to this yet poorly sampled part of the exoplanet parameter space with Earth-like planets.


title: Deciding What to Model: Value-Equivalent Sampling for Reinforcement Learning

abstract: The quintessential model-based reinforcement-learning agent iteratively refines its estimates or prior beliefs about the true underlying model of the environment. Recent empirical successes in model-based reinforcement learning with function approximation, however, eschew the true model in favor of a surrogate that, while ignoring various facets of the environment, still facilitates effective planning over behaviors. Recently formalized as the value equivalence principle, this algorithmic technique is perhaps unavoidable as real-world reinforcement learning demands consideration of a simple, computationally-bounded agent interacting with an overwhelmingly complex environment, whose underlying dynamics likely exceed the agent's capacity for representation. In this work, we consider the scenario where agent limitations may entirely preclude identifying an exactly value-equivalent model, immediately giving rise to a trade-off between identifying a model that is simple enough to learn while only incurring bounded sub-optimality. To address this problem, we introduce an algorithm that, using rate-distortion theory, iteratively computes an approximately-value-equivalent, lossy compression of the environment which an agent may feasibly target in lieu of the true model. We prove an information-theoretic, Bayesian regret bound for our algorithm that holds for any finite-horizon, episodic sequential decision-making problem. Crucially, our regret bound can be expressed in one of two possible forms, providing a performance guarantee for finding either the simplest model that achieves a desired sub-optimality gap or, alternatively, the best model given a limit on agent capacity.


title: Non-Markovian transient spectroscopy in cavity QED

abstract: We theoretically analyze measurements of the transient field leaving a cavity as a tool for studying non-Markovian dynamics in cavity quantum electrodynamics (QED). Combined with a dynamical decoupling pulse sequence, transient spectroscopy can be used to recover spectral features that may be obscured in the stationary cavity transmission spectrum due to inhomogeneous broadening. The formalism introduced here can be leveraged to perform in situ noise spectroscopy, revealing a robust signature of quantum noise arising from non-commuting observables, a purely quantum effect.


title: Explaining Hyperproperty Violations

abstract: Hyperproperties relate multiple computation traces to each other. Model checkers for hyperproperties thus return, in case a system model violates the specification, a set of traces as a counterexample. Fixing the erroneous relations between traces in the system that led to the counterexample is a difficult manual effort that highly benefits from additional explanations. In this paper, we present an explanation method for counterexamples to hyperproperties described in the specification logic HyperLTL. We extend Halpern and Pearl's definition of actual causality to sets of traces witnessing the violation of a HyperLTL formula, which allows us to identify the events that caused the violation. We report on the implementation of our method and show that it significantly improves on previous approaches for analyzing counterexamples returned by HyperLTL model checkers.


title: Differentiable Point Scattering Models for Efficient Radar Target Characterization

abstract: Target characterization is an important step in many defense missions, often relying on fitting a known target model to observed data. Optimization of model parameters can be computationally expensive depending on the model complexity, thus having models that both describe the data well and that can be efficiently optimized is critical. This work introduces a class of radar models that can be used to represent the radar scattering response of a target at high frequencies while also enabling the use of gradient-based optimization.


title: Estimating Particle Size for Therapeutic Application of Boron in Proton Therapy using the Finite Element Method

abstract: Previous measurements have shown large cross sections for the 11B(p,$\alpha$)8Be reaction and K-shell ionization of boron from H+ ions. Past publications have shown that this reaction will likely increase the efficacy of proton therapy. This study investigates the size of boron particles for optimum treatment enhancement in proton therapy. Simulations of protons passing through varying sized boron particles were developed to compare energy outputs for alpha particles and low energy electrons. The results for the boron particle radius that produced the largest radiation output are presented in graphical form in this paper. The radius that produced the largest Auger output was determined to be 1.3 nm. The results indicate that maximum dose enhancement will depend on the limiting factors of the biological system in regards to the appropriately sized particle. Studying different reactions that may be applied in hadron therapies allows researchers and physicians to target tumor sites more selectively.


title: RPEM: Randomized Monte Carlo Parametric Expectation Maximization Algorithm

abstract: Inspired from quantum Monte Carlo, by using unbiased estimators all the time and sampling discrete and continuous variables at the same time using Metropolis algorithm, we present a novel, fast, and accurate high performance Monte Carlo Parametric Expectation Maximization (MCPEM) algorithm. We named it Randomized Parametric Expectation Maximization (RPEM). In particular, we compared RPEM with Monolix's SAEM and Certara's QRPEM for a realistic two-compartment Voriconazole model with ordinary differential equations (ODEs) and using simulated data. We show that RPEM is 3 to 4 times faster than SAEM and QRPEM, and more accurate than them in reconstructing the population parameters.


title: Straggler-Resilient Personalized Federated Learning

abstract: Federated Learning is an emerging learning paradigm that allows training models from samples distributed across a large network of clients while respecting privacy and communication restrictions. Despite its success, federated learning faces several challenges related to its decentralized nature. In this work, we develop a novel algorithmic procedure with theoretical speedup guarantees that simultaneously handles two of these hurdles, namely (i) data heterogeneity, i.e., data distributions can vary substantially across clients, and (ii) system heterogeneity, i.e., the computational power of the clients could differ significantly. Our method relies on ideas from representation learning theory to find a global common representation using all clients' data and learn a user-specific set of parameters leading to a personalized solution for each client. Furthermore, our method mitigates the effects of stragglers by adaptively selecting clients based on their computational characteristics and statistical significance, thus achieving, for the first time, near optimal sample complexity and provable logarithmic speedup. Experimental results support our theoretical findings showing the superiority of our method over alternative personalized federated schemes in system and data heterogeneous environments.


title: Multilingual Neural Machine Translation with Deep Encoder and Multiple Shallow Decoders

abstract: Recent work in multilingual translation advances translation quality surpassing bilingual baselines using deep transformer models with increased capacity. However, the extra latency and memory costs introduced by this approach may make it unacceptable for efficiency-constrained applications. It has recently been shown for bilingual translation that using a deep encoder and shallow decoder (DESD) can reduce inference latency while maintaining translation quality, so we study similar speed-accuracy trade-offs for multilingual translation. We find that for many-to-one translation we can indeed increase decoder speed without sacrificing quality using this approach, but for one-to-many translation, shallow decoders cause a clear quality drop. To ameliorate this drop, we propose a deep encoder with multiple shallow decoders (DEMSD) where each shallow decoder is responsible for a disjoint subset of target languages. Specifically, the DEMSD model with 2-layer decoders is able to obtain a 1.8x speedup on average compared to a standard transformer model with no drop in translation quality.


title: Stability and Spatial Autocorrelations of Suspensions of Microswimmers with Heterogeneous Spin

abstract: Hydrodynamical interactions of active micro-particles are pervasive in our planet's fluid environments. Hence, understanding the interactions of these self-propelled particles is essential for science and engineering. In this paper the suspensions of active swimmer-rotor particles have been mathematically modeled by extending a previously developed stochastic kinetic theory to analyze heterogeneous collections of microswimmers and microrotors with multiple spin velocity populations. The paper uses this modeling approach to derive insights on large scale properties such as suspension instabilities and spatial correlations of the active particles and highlights the role of active particle rotations on the behavior of the suspension. This study will have an eye on analytically explaining pattern formation results observed for self-propelled micro-particles using numerical and lab experiments.


title: Piezoelectric quantum spin Hall insulator VCClBr monolayer with pure out-of-plane piezoelectric response

abstract: The combination of piezoelectricity with nontrivial topological insulating phase in two-dimensional (2D) systems, namely piezoelectric quantum spin Hall insulator (PQSHI), is intriguing for exploring novel topological states toward the development of high-speed and dissipationless electronic devices. In this work, we predict a PQSHI Janus monolayer VCClBr constructed from $\mathrm{VCCl_2}$, which is dynamically, mechanically and thermally stable. In the absence of spin orbital coupling (SOC), VCClBr is a narrow gap semiconductor with gap value of 57 meV, which is different from Dirac semimetal $\mathrm{VCCl_2}$. The gap of VCClBr is due to built-in electric field caused by asymmetrical upper and lower atomic layers, which is further confirmed by external-electric-field induced gap in $\mathrm{VCCl_2}$. When including SOC, the gap of VCClBr is improved to 76 meV, which is larger than the thermal energy of room temperature (25 meV). The VCClBr is a 2D topological insulator (TI), which is confirmed by $Z_2$ topological invariant and nontrivial one-dimensional edge states. It is proved that the nontrivial topological properties of VCClBr are robust against strain (biaxial and uniaxial cases) and external electric field. Due to broken horizontal mirror symmetry, only out-of-plane piezoelectric response can be observed, when biaxial or uniaxial in-plane strain is applied. The predicted piezoelectric strain coefficients $d_{31}$ and $d_{32}$ are -0.425 pm/V and -0.219 pm/V, which are higher than or compared with ones of many 2D materials. Finally, another two Janus monolayer VCFBr and VCFCl (dynamically unstable) are constructed, and they are still PQSHIs. Moreover, their $d_{31}$ and $d_{32}$ are higher than ones of VCClBr, and the $d_{31}$ (absolute value) of VCFBr is larger than one.


title: Towards Fast Adaptation of Pretrained Contrastive Models for Multi-channel Video-Language Retrieval

abstract: Multi-channel video-language retrieval require models to understand information from different channels (e.g. video$+$question, video$+$speech) to correctly link a video with a textual response or query. Fortunately, contrastive multimodal models are shown to be highly effective at aligning entities in images/videos and text, e.g., CLIP; text contrastive models are extensively studied recently for their strong ability of producing discriminative sentence embeddings, e.g., SimCSE. However, there is not a clear way to quickly adapt these two lines to multi-channel video-language retrieval with limited data and resources. In this paper, we identify a principled model design space with two axes: how to represent videos and how to fuse video and text information. Based on categorization of recent methods, we investigate the options of representing videos using continuous feature vectors or discrete text tokens; for the fusion method, we explore the use of a multimodal transformer or a pretrained contrastive text model. We extensively evaluate the four combinations on five video-language datasets. We surprisingly find that discrete text tokens coupled with a pretrained contrastive text model yields the best performance, which can even outperform state-of-the-art on the iVQA and How2QA datasets without additional training on millions of video-text data. Further analysis shows that this is because representing videos as text tokens captures the key visual information and text tokens are naturally aligned with text models that are strong retrievers after the contrastive pretraining process. All the empirical analysis establishes a solid foundation for future research on affordable and upgradable multimodal intelligence.


title: Geometric Theory for Program Testing

abstract: Formal methods for verification of programs are extended to testing of programs. Their combination is intended to lead to benefits in reliable program development, testing, and evolution. Our geometric theory of testing is intended to serve as the specification of a testing environment, included as the last stage of a toolchain that assists professional programmers, amateurs, and students of Computer Science. The testing environment includes an automated algorithm which locates errors in a test that has been run, and assists in correcting them. It does this by displaying, on a monitor screen, a stick diagram of causal chains in the execution of the program under test. The diagram can then be navigated backwards in the familiar style of a satnav following roads on a map. This will reveal selections of places at which the program should be modified to remove the error.


title: The relative class number one problem for function fields, II

abstract: We establish that any finite extension of function fields of genus greater than 1 whose relative class group is trivial is Galois and cyclic. This depends on a result from a preceding paper which establishes a finite list of possible Weil polynomials for both fields. Given this list, we analyze most cases by computing options for the splittings of low-degree places in the extension, then consider the effect of these options on the Weil polynomials of certain isogeny factors of the Jacobian of the Galois closure. In one case, we use instead an analysis based on principal polarizations, modeled on an argument of Howe.


title: Characterization of Coupled Turbulent Wind-wave Flows Based on Large Eddy Simulation

abstract: Wind-wave interaction involves wind forcing on wave surface and wave effects on the turbulent wind structures, which essentially influences the wind and wave loading on structures. Existing research on wind-wave interaction modeling ignores the inherent strong turbulences of wind. The present study aims to characterize the turbulent airflow over wave surfaces and wave dynamics under wind driving force. A high-fidelity two-phase model is developed to simulate highly turbulent wind-wave fields. Instead of using uniform wind, inherent wind turbulences are prescribed at the inlet boundary using the turbulent spot method. The developed model is validated by comparing the simulated wind-wave flow characteristics with experimental data. With the validated model, a numerical case study is conducted on a 10^2 m scale under extreme wind and wave conditions. The result shows that when inherent wind turbulences are considered, the resultant turbulence is strengthened and is the summation of the inherent turbulence and the wave-induced turbulence. In addition, the wave coherent velocities and shelter effect are enhanced because of the presence of wind inherent turbulence. The regions of intense turbulence depend on the relative speed between wind velocity and wave phase speed. Higher wind velocities induce greater turbulence intensities, which can be increased by up to 17%. The different relative speed between wind and wave can induce opposite positive-negative patterns of wave coherent velocities. The wave-coherent velocity is approximately proportional to the wind velocity, and the influenced region mainly depends on the wave heights.


title: Towards the Creation of a Nutrition and Food Group Based Image Database

abstract: Food classification is critical to the analysis of nutrients comprising foods reported in dietary assessment. Advances in mobile and wearable sensors, combined with new image based methods, particularly deep learning based approaches, have shown great promise to improve the accuracy of food classification to assess dietary intake. However, these approaches are data-hungry and their performances are heavily reliant on the quantity and quality of the available datasets for training the food classification model. Existing food image datasets are not suitable for fine-grained food classification and the following nutrition analysis as they lack fine-grained and transparently derived food group based identification which are often provided by trained dietitians with expert domain knowledge. In this paper, we propose a framework to create a nutrition and food group based image database that contains both visual and hierarchical food categorization information to enhance links to the nutrient profile of each food. We design a protocol for linking food group based food codes in the U.S. Department of Agriculture's (USDA) Food and Nutrient Database for Dietary Studies (FNDDS) to a food image dataset, and implement a web-based annotation tool for efficient deployment of this protocol.Our proposed method is used to build a nutrition and food group based image database including 16,114 food images representing the 74 most frequently consumed What We Eat in America (WWEIA) food sub-categories in the United States with 1,865 USDA food code matched to a nutrient database, the USDA FNDDS nutrient database.


title: Accurate Scoliosis Vertebral Landmark Localization on X-ray Images via Shape-constrained Multi-stage Cascaded CNNs

abstract: Vertebral landmark localization is a crucial step for variant spine-related clinical applications, which requires detecting the corner points of 17 vertebrae. However, the neighbor landmarks often disturb each other for the homogeneous appearance of vertebrae, which makes vertebral landmark localization extremely difficult. In this paper, we propose multi-stage cascaded convolutional neural networks (CNNs) to split the single task into two sequential steps, i.e., center point localization to roughly locate 17 center points of vertebrae, and corner point localization to find 4 corner points for each vertebra without distracted by others. Landmarks in each step are located gradually from a set of initialized points by regressing offsets via cascaded CNNs. Principal Component Analysis (PCA) is employed to preserve a shape constraint in offset regression to resist the mutual attraction of vertebrae. We evaluate our method on the AASCE dataset that consists of 609 tight spinal anterior-posterior X-ray images and each image contains 17 vertebrae composed of the thoracic and lumbar spine for spinal shape characterization. Experimental results demonstrate our superior performance of vertebral landmark localization over other state-of-the-arts with the relative error decreasing from 3.2e-3 to 7.2e-4.


title: Model-Agnostic Confidence Intervals for Feature Importance: A Fast and Powerful Approach Using Minipatch Ensembles

abstract: To promote new scientific discoveries from complex data sets, feature importance inference has been a long-standing statistical problem. Instead of testing for parameters that are only interpretable for specific models, there has been increasing interest in model-agnostic methods, often in the form of feature occlusion or leave-one-covariate-out (LOCO) inference. Existing approaches often make distributional assumptions, which can be difficult to verify in practice, or require model refitting and data splitting, which are computationally intensive and lead to losses in power. In this work, we develop a novel, mostly model-agnostic and distribution-free inference framework for feature importance that is computationally efficient and statistically powerful. Our approach is fast as we avoid model refitting by leveraging a form of random observation and feature subsampling called minipatch ensembles; this approach also improves statistical power by avoiding data splitting. Our framework can be applied on tabular data and with any machine learning algorithm, together with minipatch ensembles, for regression and classification tasks. Despite the dependencies induced by using minipatch ensembles, we show that our approach provides asymptotic coverage for the feature importance score of any model under mild assumptions. Finally, our same procedure can also be leveraged to provide valid confidence intervals for predictions, hence providing fast, simultaneous quantification of the uncertainty of both predictions and feature importance. We validate our intervals on a series of synthetic and real data examples, including non-linear settings, showing that our approach detects the correct important features and exhibits many computational and statistical advantages over existing methods.


title: Avoiding localization instabilities in rotary pleating

abstract: Rotary pleating is a widely used process for making filters out of nonwoven fabric sheets. This involves indirect elastic-plastic bending of pre-weakened creases by continuously injecting material into an accordion-shaped pack. This step can fail through a localization instability that creates a kink in a pleat facet instead of in the desired crease location. In the present work, we consider the effects of geometric and material parameters on the rotary pleating process. We formulate the process as a multi-point variable-arc-length boundary value problem for planar inextensible rods, with hinge connections. Both the facets (rods) and creases (hinges) obey nonlinear moment-curvature or moment-angle constitutive laws. Some unexpected aspects of the sleeve boundary condition at the point of material injection, common to many continuous sheet processes, are noted. The process, modeled as quasistatic, features multiple equilibria which we explore by numerical continuation. The presence of, presumably stable, kinked equilibria is taken as a conservative sign of potential pleating failure. Failure may also occur due to localization at the injection point. We may thus obtain "pleatability surfaces" that separate the parameter space into regions where mechanical pleating will succeed or fail. Successful pleating depends primarily on the distance between the injection point and the pleated pack. Other factors, such as the crease stiffness and strength relative to that of the facets, also have an influence. Our approach can be adapted to study other pleating and forming processes, the deployment and collapse of folded structures, or multi-stability in compliant structures.


title: Acceleration and Expansion of a Coronal Mass Ejection in the High Corona: Role of Magnetic Reconnection

abstract: The important role played by magnetic reconnection in the early acceleration of coronal mass ejections (CMEs) has been widely discussed. However, as CMEs may have expansion speeds comparable to their propagation speeds in the corona, it is not clear whether and how reconnection contributes to the true acceleration and expansion separately. To address this question, we analyze the dynamics of a moderately fast CME on 2013 February 27, associated with a continuous acceleration of its front into the high corona, even though its speed had reached $\sim$700~km~s$^{-1}$ and larger than the solar wind speed. The apparent CME acceleration is found to be due to the CME expansion in the radial direction. The CME true acceleration, i.e., the acceleration of its center, is then estimated by taking into account the expected deceleration caused by the solar wind drag force acting on a fast CME. It is found that the true acceleration and the radial expansion have similar magnitudes. We find that magnetic reconnection occurs after the CME eruption and continues during the CME propagation in the high corona, which contributes to the CME dynamic evolution. Comparison between the apparent acceleration related to the expansion and the true acceleration that compensates the drag shows that, for this case, magnetic reconnection contributes almost equally to the CME expansion and to the CME acceleration. The consequences of these measurements for the evolution of CMEs as they transit from the corona to the heliosphere are discussed.


title: A force-based gradient descent method for $\mathit{\text{ab initio}}$ atomic structure relaxation

abstract: Force-based algorithms for $\mathit{\text{ab initio}}$ atomic structure relaxation, such as conjugate gradient methods, usually get stuck in the line minimization processes along search directions, where expensive $\mathit{\text{ab initio}}$ calculations are triggered frequently to test trial positions before locating the next iterate. We present a force-based gradient descent method, WANBB, that circumvents the deficiency. At each iteration, WANBB enters the line minimization process with a trial stepsize capturing the local curvature of the energy surface. The exit is controlled by an unrestrictive criterion that tends to accept early trials. These two ingredients streamline the line minimization process in WANBB. The numerical simulations on nearly 80 systems with good universality demonstrate the considerable compression of WANBB on the cost for the unaccepted trials compared with conjugate gradient methods. We also observe across the board significant and universal speedups as well as the superior robustness of WANBB over several widely used methods. The latter point is theoretically established. The implementation of WANBB is pretty simple, in that no a priori physical knowledge is required and only two parameters are present without tuning.


title: Bandit Theory and Thompson Sampling-Guided Directed Evolution for Sequence Optimization

abstract: Directed Evolution (DE), a landmark wet-lab method originated in 1960s, enables discovery of novel protein designs via evolving a population of candidate sequences. Recent advances in biotechnology has made it possible to collect high-throughput data, allowing the use of machine learning to map out a protein's sequence-to-function relation. There is a growing interest in machine learning-assisted DE for accelerating protein optimization. Yet the theoretical understanding of DE, as well as the use of machine learning in DE, remains limited. In this paper, we connect DE with the bandit learning theory and make a first attempt to study regret minimization in DE. We propose a Thompson Sampling-guided Directed Evolution (TS-DE) framework for sequence optimization, where the sequence-to-function mapping is unknown and querying a single value is subject to costly and noisy measurements. TS-DE updates a posterior of the function based on collected measurements. It uses a posterior-sampled function estimate to guide the crossover recombination and mutation steps in DE. In the case of a linear model, we show that TS-DE enjoys a Bayesian regret of order $\tilde O(d^{2}\sqrt{MT})$, where $d$ is feature dimension, $M$ is population size and $T$ is number of rounds. This regret bound is nearly optimal, confirming that bandit learning can provably accelerate DE. It may have implications for more general sequence optimization and evolutionary algorithms.


title: LAE: Language-Aware Encoder for Monolingual and Multilingual ASR

abstract: Despite the rapid progress in automatic speech recognition (ASR) research, recognizing multilingual speech using a unified ASR system remains highly challenging. Previous works on multilingual speech recognition mainly focus on two directions: recognizing multiple monolingual speech or recognizing code-switched speech that uses different languages interchangeably within a single utterance. However, a pragmatic multilingual recognizer is expected to be compatible with both directions. In this work, a novel language-aware encoder (LAE) architecture is proposed to handle both situations by disentangling language-specific information and generating frame-level language-aware representations during encoding. In the LAE, the primary encoding is implemented by the shared block while the language-specific blocks are used to extract specific representations for each language. To learn language-specific information discriminatively, a language-aware training method is proposed to optimize the language-specific blocks in LAE. Experiments conducted on Mandarin-English code-switched speech suggest that the proposed LAE is capable of discriminating different languages in frame-level and shows superior performance on both monolingual and multilingual ASR tasks. With either a real-recorded or simulated code-switched dataset, the proposed LAE achieves statistically significant improvements on both CTC and neural transducer systems. Code is released


title: Using Connectome Features to Constrain Echo State Networks

abstract: We report an improvement to the conventional Echo State Network (ESN) across three benchmark chaotic time-series prediction tasks using fruit fly connectome data alone. We also investigate the impact of key connectome-derived structural features on prediction performance -- uniquely bridging neurobiological structure and machine learning function; and find that both increasing the global average clustering coefficient and modifying the position of weights -- by permuting their synapse-synapse partners -- can lead to increased model variance and (in some cases) degraded performance. In all we consider four topological point modifications to a connectome-derived ESN reservoir (null model): namely, we alter the network sparsity, re-draw nonzero weights from a uniform distribution, permute nonzero weight positions, and increase the network global average clustering coefficient. We compare the four resulting ESN model classes -- and the null model -- with a conventional ESN by conducting time-series prediction experiments on size-variants of the Mackey-Glass 17 (MG-17), Lorenz, and Rossler chaotic time series; denoting each model's performance and variance across train-validate trials.


title: ARC - Actor Residual Critic for Adversarial Imitation Learning

abstract: Adversarial Imitation Learning (AIL) is a class of popular state-of-the-art Imitation Learning algorithms commonly used in robotics. In AIL, an artificial adversary's misclassification is used as a reward signal that is optimized by any standard Reinforcement Learning (RL) algorithm. Unlike most RL settings, the reward in AIL is $differentiable$ but current model-free RL algorithms do not make use of this property to train a policy. The reward is AIL is also shaped since it comes from an adversary. We leverage the differentiability property of the shaped AIL reward function and formulate a class of Actor Residual Critic (ARC) RL algorithms. ARC algorithms draw a parallel to the standard Actor-Critic (AC) algorithms in RL literature and uses a residual critic, $C$ function (instead of the standard $Q$ function) to approximate only the discounted future return (excluding the immediate reward). ARC algorithms have similar convergence properties as the standard AC algorithms with the additional advantage that the gradient through the immediate reward is exact. For the discrete (tabular) case with finite states, actions, and known dynamics, we prove that policy iteration with $C$ function converges to an optimal policy. In the continuous case with function approximation and unknown dynamics, we experimentally show that ARC aided AIL outperforms standard AIL in simulated continuous-control and real robotic manipulation tasks. ARC algorithms are simple to implement and can be incorporated into any existing AIL implementation with an AC algorithm. Video and link to code are available at: https://sites.google.com/view/actor-residual-critic.


title: PEER: A Comprehensive and Multi-Task Benchmark for Protein Sequence Understanding

abstract: We are now witnessing significant progress of deep learning methods in a variety of tasks (or datasets) of proteins. However, there is a lack of a standard benchmark to evaluate the performance of different methods, which hinders the progress of deep learning in this field. In this paper, we propose such a benchmark called PEER, a comprehensive and multi-task benchmark for Protein sEquence undERstanding. PEER provides a set of diverse protein understanding tasks including protein function prediction, protein localization prediction, protein structure prediction, protein-protein interaction prediction, and protein-ligand interaction prediction. We evaluate different types of sequence-based methods for each task including traditional feature engineering approaches, different sequence encoding methods as well as large-scale pre-trained protein language models. In addition, we also investigate the performance of these methods under the multi-task learning setting. Experimental results show that large-scale pre-trained protein language models achieve the best performance for most individual tasks, and jointly training multiple tasks further boosts the performance. The datasets and source codes of this benchmark are all available at https://github.com/DeepGraphLearning/PEER_Benchmark


title: Invariant Seifert surfaces for strongly invertible knots

abstract: We study invariant Seifert surfaces for strongly invertible knots, and prove that the gap between the equivariant genus (the minimum of the genera of invariant Seifert surfaces) of a strongly invertible knot and the (usual) genus of the underlying knot can be arbitrary large. This forms a sharp contrast with Edmonds' theorem that every periodic knot admits an invariant minimal genus Seifert surface. We also prove variants of Edmonds' theorem, which are useful in studying invariant Seifert surfaces for strongly invertible knots.


title: Search Space Adaptation for Differentiable Neural Architecture Search in Image Classification

abstract: As deep neural networks achieve unprecedented performance in various tasks, neural architecture search (NAS), a research field for designing neural network architectures with automated processes, is actively underway. More recently, differentiable NAS has a great impact by reducing the search cost to the level of training a single network. Besides, the search space that defines candidate architectures to be searched directly affects the performance of the final architecture. In this paper, we propose an adaptation scheme of the search space by introducing a search scope. The effectiveness of proposed method is demonstrated with ProxylessNAS for the image classification task. Furthermore, we visualize the trajectory of architecture parameter updates and provide insights to improve the architecture search.


title: Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentation

abstract: This article addresses the problem of distilling knowledge from a large teacher model to a slim student network for LiDAR semantic segmentation. Directly employing previous distillation approaches yields inferior results due to the intrinsic challenges of point cloud, i.e., sparsity, randomness and varying density. To tackle the aforementioned problems, we propose the Point-to-Voxel Knowledge Distillation (PVD), which transfers the hidden knowledge from both point level and voxel level. Specifically, we first leverage both the pointwise and voxelwise output distillation to complement the sparse supervision signals. Then, to better exploit the structural information, we divide the whole point cloud into several supervoxels and design a difficulty-aware sampling strategy to more frequently sample supervoxels containing less-frequent classes and faraway objects. On these supervoxels, we propose inter-point and inter-voxel affinity distillation, where the similarity information between points and voxels can help the student model better capture the structural information of the surrounding environment. We conduct extensive experiments on two popular LiDAR segmentation benchmarks, i.e., nuScenes and SemanticKITTI. On both benchmarks, our PVD consistently outperforms previous distillation approaches by a large margin on three representative backbones, i.e., Cylinder3D, SPVNAS and MinkowskiNet. Notably, on the challenging nuScenes and SemanticKITTI datasets, our method can achieve roughly 75% MACs reduction and 2x speedup on the competitive Cylinder3D model and rank 1st on the SemanticKITTI leaderboard among all published algorithms. Our code is available at https://github.com/cardwing/Codes-for-PVKD.


title: ACORN: Network Control Plane Abstraction using Route Nondeterminism

abstract: Networks are hard to configure correctly, and misconfigurations occur frequently, leading to outages or security breaches. Formal verification techniques have been applied to guarantee the correctness of network configurations, thereby improving network reliability. This work addresses verification of distributed network control planes, with two distinct contributions to improve the scalability of formal verification. Our first contribution is a hierarchy of abstractions of varying precision which introduce nondeterminism into the route selection procedure that routers use to select the best available route. We prove the soundness of these abstractions and show their benefits. Our second contribution is a novel SMT encoding which uses symbolic graphs to encode all possible stable routing trees that are compliant with the given network control plane configurations. We have implemented our abstractions and SMT encodings in a prototype tool called ACORN. Our evaluations show that our abstractions can provide significant relative speedups (up to 323x) in performance, and ACORN can scale up to $\approx37,000$ routers (organized in FatTree topologies, with synthesized shortest-path routing and valley-free policies) for verifying reachability. This far exceeds the performance of existing tools for control plane verification.


title: Selection of turbulence models via multiscaling analysis of an axisymmetric pipe flow and heat transfer

abstract: To fully evaluate a turbulent flow, Direct Numerical Simulation (DNS) is the most accurate method by far and requires considerable computational power and time; not optimum for industry standards. Developing an alternative model, providing results with reasonable accuracy would resolve this issue. Reynolds Averaged Navier Stokes (RANS) modeling has proven its worth in addressing this phenomenon. In this study, we investigated the RANS turbulence models from COMSOL for fully developed single-phase flow in a two-dimensional axisymmetric pipe domain with constant heating at the wall and periodic boundary conditions at the inlet and outlet. Heat transfer in the fluid module has been added to address the heat transfer phenomenon. We evaluated the computed results with existing DNS data to match the accuracy of the RANS models. RANS simulations are conducted for friction Reynolds number, i.e., Re_{\tau}= 180, 314, and 395 with varying Prandtl numbers, i.e., Pr = 0.71, 2, 5, and 7. Multiscaling analyses in the flow's inner, outer, and meso scaling regions are performed for fluid and heat transfer profiles, i.e., mean streamwise velocity, Reynolds shear stress, mean streamwise temperature, and turbulent heat flux, to compare with the DNS data. The investigation reports the scaling analysis's effectiveness and shows that RANS turbulence models can be used to describe such flow with reasonable accuracy.


title: AUTM Flow: Atomic Unrestricted Time Machine for Monotonic Normalizing Flows

abstract: Nonlinear monotone transformations are used extensively in normalizing flows to construct invertible triangular mappings from simple distributions to complex ones. In existing literature, monotonicity is usually enforced by restricting function classes or model parameters and the inverse transformation is often approximated by root-finding algorithms as a closed-form inverse is unavailable. In this paper, we introduce a new integral-based approach termed "Atomic Unrestricted Time Machine (AUTM)", equipped with unrestricted integrands and easy-to-compute explicit inverse. AUTM offers a versatile and efficient way to the design of normalizing flows with explicit inverse and unrestricted function classes or parameters. Theoretically, we present a constructive proof that AUTM is universal: all monotonic normalizing flows can be viewed as limits of AUTM flows. We provide a concrete example to show how to approximate any given monotonic normalizing flow using AUTM flows with guaranteed convergence. The result implies that AUTM can be used to transform an existing flow into a new one equipped with explicit inverse and unrestricted parameters. The performance of the new approach is evaluated on high dimensional density estimation, variational inference and image generation. Experiments demonstrate superior speed and memory efficiency of AUTM.


title: Travelling wave solutions of a bistable reaction-diffusion equation with nonlinear jump discontinuity

abstract: This paper is concerned with the existence and the stability of travelling wave solutions to a bistable reaction-diffusion equation with a jump discontinuious point on nonlinear term. Sub-super solution method is used throughout this paper. As a matter of fact, this nonlinear discontinuity term is frequently emerging when study the travelling wave solution of reaction-diffusion-ODE systems. Hence, it is meaningful to consider this kind of problem.


title: ContraCLIP: Interpretable GAN generation driven by pairs of contrasting sentences

abstract: This work addresses the problem of discovering non-linear interpretable paths in the latent space of pre-trained GANs in a model-agnostic manner. In the proposed method, the discovery is driven by a set of pairs of natural language sentences with contrasting semantics, named semantic dipoles, that serve as the limits of the interpretation that we require by the trainable latent paths to encode. By using the pre-trained CLIP encoder, the sentences are projected into the vision-language space, where they serve as dipoles, and where RBF-based warping functions define a set of non-linear directional paths, one for each semantic dipole, allowing in this way traversals from one semantic pole to the other. By defining an objective that discovers paths in the latent space of GANs that generate changes along the desired paths in the vision-language embedding space, we provide an intuitive way of controlling the underlying generative factors and address some of the limitations of the state-of-the-art works, namely, that a) they are typically tailored to specific GAN architectures (i.e., StyleGAN), b) they disregard the relative position of the manipulated and the original image in the image embedding and the relative position of the image and the text embeddings, and c) they lead to abrupt image manipulations and quickly arrive at regions of low density and, thus, low image quality, providing limited control of the generative factors. We provide extensive qualitative and quantitative results that demonstrate our claims with two pre-trained GANs, and make the code and the pre-trained models publicly available at: https://github.com/chi0tzp/ContraCLIP


title: Estimating the Morse index of free boundary minimal hypersurfaces through covering arguments

abstract: Given a compact Riemannian manifold, of dimension between 3 and 7, with boundary, we adapt Song's method in Song (2023) to the free boundary case to show that the Morse index of a free boundary minimal hypersurface grows linearly with the sum of its Betti numbers, where the constant of growth depends on the area of the free boundary minimal hypersurface in question.


title: Do we need dense matter equation of state in curved spacetime for neutron stars?

abstract: Neutron stars are regarded as natural laboratories for the study of dense strong interaction matter. The equation of state (EoS) of dense matter computed in flat spacetime is used to predict the structure of neutron stars by solving the Tolman-Oppenheimer-Volkoff (TOV) equation. Recently, it has been reported that the curved spacetime effect or specifically gravitational time dilation effect on the EoS of dense matter leads to a significant increase of the maximum mass limit of neutron stars [Phys. Rev. D \textbf{104}, 123005 (2021) and J. Cosmol. Astropart. Phys. 02 (2021) 026]. However, in this work, we show that to study the hydrostatic equilibrium of dense matter within the framework of general relativity and relativistic fluid dynamics, the grand canonical EoS of dense matter, $p(T,\mu)$, should be the same as that computed in flat spacetime, otherwise it is not consistent with local thermodynamic relations and energy-momentum conservation of the fluid. The gravitation influences the pressure $p$ only through enhancing the temperature $T$ and the chemical potential $\mu$, known as Tolman's law and Klein's law. We rewrite the TOV equation as an alternative version so that the grand canonical EoS computed by using field theoretical methods can be used as a direct input. This may provide a tool to study the grand canonical EoS of dense matter via deep learning.


title: Interpretable Mixture of Experts

abstract: The need for reliable model explanations is prominent for many machine learning applications, particularly for tabular and time-series data as their use cases often involve high-stakes decision making. Towards this goal, we introduce a novel interpretable modeling framework, Interpretable Mixture of Experts (IME), that yields high accuracy, comparable to `black-box' Deep Neural Networks (DNNs) in many cases, along with useful interpretability capabilities. IME consists of an assignment module and a mixture of experts, with each sample being assigned to a single expert for prediction. We introduce multiple options for IME based on the assignment and experts being interpretable. When the experts are chosen to be interpretable such as linear models, IME yields an inherently-interpretable architecture where the explanations produced by IME are the exact descriptions of how the prediction is computed. In addition to constituting a standalone inherently-interpretable architecture, IME has the premise of being integrated with existing DNNs to offer interpretability to a subset of samples while maintaining the accuracy of the DNNs. Through extensive experiments on 15 tabular and time-series datasets, IME is demonstrated to be more accurate than single interpretable models and perform comparably with existing state-of-the-art DNNs in accuracy. On most datasets, IME even outperforms DNNs, while providing faithful explanations. Lastly, IME's explanations are compared to commonly-used post-hoc explanations methods through a user study -- participants are able to better predict the model behavior when given IME explanations, while finding IME's explanations more faithful and trustworthy.


title: Uniqueness of orders and parameters in multi-term time-fractional diffusion equations by short-time behavior

abstract: As the most significant difference from parabolic equations, long-time or short-time behavior of solutions to time-fractional evolution equations is dominated by the fractional orders, whose unique determination has been frequently investigated in literature. Unlike all the existing results, in this article we prove the uniqueness of orders and parameters (up to a multiplier for the latter) only by principal terms of asymptotic expansions of solutions near $t=0$ at a single spatial point. Moreover, we discover special conditions on unknown initial values or source terms for the coincidence of observation data. As a byproduct, we can even conclude the uniqueness for initial values or source terms by the same data. The proof relies on the asymptotic expansion after taking the Laplace transform and the completeness of generalized eigenfunctions.


title: Delay Alignment Modulation: Manipulating Channel Delay Spread for Efficient Single- and Multi-Carrier Communication

abstract: The evolution of mobile communication networks has always been accompanied by the advancement of ISI mitigation techniques, from equalization in 2G, spread spectrum and RAKE receiver in 3G, to OFDM in 4G and 5G. Looking forward towards 6G, by exploiting the high spatial resolution brought by large antenna arrays and the multi-path sparsity of mmWave and Terahertz channels, a novel ISI mitigation technique termed delay alignment modulation (DAM) was recently proposed. However, existing works only consider the single-carrier perfect DAM, which is feasible only when the number of BS antennas is no smaller than that of channel paths, so that all multi-path signal components arrive at the receiver simultaneously and constructively. This imposes stringent requirements on the number of BS antennas and multi-path sparsity. In this paper, we propose a generic DAM technique to manipulate the channel delay spread via spatial-delay processing, thus providing a flexible framework to combat channel time dispersion for efficient single- or multi-carrier transmissions. We first show that when the number of BS antennas is much larger than that of channel paths, perfect delay alignment can be achieved to transform the time-dispersive channel to time non-dispersive channel with the simple delay pre-compensation and path-based MRT beamforming. When perfect DAM is infeasible or undesirable, the proposed generic DAM technique can be applied to significantly reduce the channel delay spread. We further propose the novel DAM-OFDM technique, which is able to save the CP overhead or mitigate the PAPR issue suffered by conventional OFDM. We show that the proposed DAM-OFDM involves joint frequency- and time-domain beamforming optimization, for which a closed-form solution is derived. Simulation results show that the proposed DAM-OFDM outperforms the conventional OFDM in terms of spectral efficiency, BER and PAPR.


title: Computer Vision-based Characterization of Large-scale Jet Flames using a Synthetic Infrared Image Generation Approach

abstract: Among the different kinds of fire accidents that can occur during industrial activities that involve hazardous materials, jet fires are one of the lesser-known types. This is because they are often involved in a process that generates a sequence of other accidents of greater magnitude, known as domino effect. Flame impingement usually causes domino effects, and jet fires present specific features that can significantly increase the probability of this happening. These features become relevant from a risk analysis perspective, making their proper characterization a crucial task. Deep Learning approaches have become extensively used for tasks such as jet fire characterization; however, these methods are heavily dependent on the amount of data and the quality of the labels. Data acquisition of jet fires involve expensive experiments, especially so if infrared imagery is used. Therefore, this paper proposes the use of Generative Adversarial Networks to produce plausible infrared images from visible ones, making experiments less expensive and allowing for other potential applications. The results suggest that it is possible to realistically replicate the results for experiments carried out using both visible and infrared cameras. The obtained results are compared with some previous experiments, and it is shown that similar results were obtained.


title: LASSO-Based Multiple-Line Outage Identification In Partially Observable Power Systems

abstract: Phasor measurement units (PMUs) create ample real-time monitoring opportunities for modern power systems. Among them, line outage detection and identification remains a crucial but challenging task. Current works on outage identification succeed in full PMU deployment and single-line outages. Performance however degrades for multiple-line outage with partial system observability. We propose a novel framework of multiple-line outage identification using partial nodal voltage measurements. Using alternating current (AC) power flow model, phase angle signatures of outages are extracted and used to group lines into minimal diagnosable clusters. Identification is then formulated into an underdetermined sparse regression problem solved by lasso. Tested on IEEE 39-bus system with 25% and 50% PMU coverage, the proposed identification method is 93% and 80% accurate for single- and double-line outages. Our study suggests that the AC power flow is better at capturing outage patterns and sacrificing some precision could yield substantial improvement in identification accuracy. These findings could contribute to the development of future control schemes that help power systems resist and recover from outage disruptions in real time.


title: Kinetic model description of dissipation and recovery in collagen fibrils under cyclic loading

abstract: Collagen fibrils, when subjected to cyclic loading, are known to exhibit hysteretic behaviour with energy dissipation that is partially recovered on relaxation. In this paper, we develop a kinetic model for a collagen fibril incorporating presence of hidden loops and stochastic fragmentation as well as reformation of sacrificial bonds. We show that the model reproduces well the characteristic features of reported experimental data on cyclic response of collagen fibrils, such as moving hysteresis loops, time evolution of residual strains and energy dissipation, recovery on relaxation, etc. We show that the approach to the steady state is controlled by a characteristic cycle number for both residual strain as well as energy dissipation, and is in good agreement with reported existing experimental data.


title: The Order of the Unitary Subgroups of Group Algebras

abstract: Let $FG$ be the group algebra of a finite $p$-group $G$ over a finite field $F$ of positive characteristic $p$. Let $\cd$ be an involution of the algebra $FG$ which is a linear extension of an anti-automorphism of the group $G$ to $FG$. If $p$ is an odd prime, then the order of the $\cd$-unitary subgroup of $FG$ is established. For the case $p=2$ we generalize a result obtained for finite abelian $2$-groups. It is proved that the order of the $*$-unitary subgroup of $FG$ of a non-abelian $2$-group is always divisible by a number which depends only on the size of $F$, the order of $G$ and the number of elements of order two in $G$. Moreover, we show that the order of the $*$-unitary subgroup of $FG$ determines the order of the finite $p$-group $G$.


title: Speech Detection Task Against Asian Hate: BERT the Central, While Data-Centric Studies the Crucial

abstract: With the COVID-19 pandemic continuing, hatred against Asians is intensifying in countries outside Asia, especially among the Chinese. There is an urgent need to detect and prevent hate speech towards Asians effectively. In this work, we first create COVID-HATE-2022, an annotated dataset including 2,025 annotated tweets fetched in early February 2022, which are labeled based on specific criteria, and we present the comprehensive collection of scenarios of hate and non-hate tweets in the dataset. Second, we fine-tune the BERT model based on the relevant datasets and demonstrate several strategies related to the "cleaning" of the tweets. Third, we investigate the performance of advanced fine-tuning strategies with various model-centric and data-centric approaches, and we show that both strategies generally improve the performance, while data-centric ones outperform the others, and it demonstrates the feasibility and effectiveness of the data-centric approaches in the associated tasks.


title: Learning Binarized Graph Representations with Multi-faceted Quantization Reinforcement for Top-K Recommendation

abstract: Learning vectorized embeddings is at the core of various recommender systems for user-item matching. To perform efficient online inference, representation quantization, aiming to embed the latent features by a compact sequence of discrete numbers, recently shows the promising potentiality in optimizing both memory and computation overheads. However, existing work merely focuses on numerical quantization whilst ignoring the concomitant information loss issue, which, consequently, leads to conspicuous performance degradation. In this paper, we propose a novel quantization framework to learn Binarized Graph Representations for Top-K Recommendation (BiGeaR). BiGeaR introduces multi-faceted quantization reinforcement at the pre-, mid-, and post-stage of binarized representation learning, which substantially retains the representation informativeness against embedding binarization. In addition to saving the memory footprint, BiGeaR further develops solid online inference acceleration with bitwise operations, providing alternative flexibility for the realistic deployment. The empirical results over five large real-world benchmarks show that BiGeaR achieves about 22%~40% performance improvement over the state-of-the-art quantization-based recommender system, and recovers about 95%~102% of the performance capability of the best full-precision counterpart with over 8x time and space reduction.


title: Cannot See the Forest for the Trees: Aggregating Multiple Viewpoints to Better Classify Objects in Videos

abstract: Recently, both long-tailed recognition and object tracking have made great advances individually. TAO benchmark presented a mixture of the two, long-tailed object tracking, in order to further reflect the aspect of the real-world. To date, existing solutions have adopted detectors showing robustness in long-tailed distributions, which derive per-frame results. Then, they used tracking algorithms that combine the temporally independent detections to finalize tracklets. However, as the approaches did not take temporal changes in scenes into account, inconsistent classification results in videos led to low overall performance. In this paper, we present a set classifier that improves accuracy of classifying tracklets by aggregating information from multiple viewpoints contained in a tracklet. To cope with sparse annotations in videos, we further propose augmentation of tracklets that can maximize data efficiency. The set classifier is plug-and-playable to existing object trackers, and highly improves the performance of long-tailed object tracking. By simply attaching our method to QDTrack on top of ResNet-101, we achieve the new state-of-the-art, 19.9% and 15.7% TrackAP_50 on TAO validation and test sets, respectively.


title: Airy-function approach to binary black hole merger waveforms: The fold-caustic diffraction model

abstract: From numerical simulations of the Einstein equations, and also from gravitational wave observations, the gravitational wave signal from a binary black hole merger is seen to be simple and to possess certain universal features. The simplicity is somewhat surprising given that non-linearities of general relativity are thought to play an important role at the merger. The universal features include an increasing amplitude as we approach the merger, where transition from an oscillatory to a damped regime occurs in a pattern apparently oblivious to the initial conditions. We propose an Airy-function pattern to model the binary black hole (BBH) merger waveform, focusing on accounting for its simplicity and universality. We postulate that the relevant universal features are controlled by a physical mechanism involving: i) a caustic phenomenon in a basic `geometric optics' approximation and, ii) a diffraction over the caustic regularizing its divergence. Universality of caustics and their diffraction patterns account for the observed universal features, as in optical phenomena such as rainbows. This postulate, if true, allows us to borrow mathematical techniques from Singularity (Catastrophe) Theory, in particular Arnol'd-Thom's theorem, and to understand binary mergers in terms of fold caustics. The diffraction pattern corresponding to the fold-caustic is given in terms of the Airy function, which leads (under a `uniform approximation') to the waveform model written in terms of a parameterized Airy function. The post-merger phase does not share the same features of simplicity and universality, and must be added separately. Nevertheless, our proposal allows a smooth matching of the inspiral and post-merger signals by using the known asymptotics of the Airy function.


title: ShapePU: A New PU Learning Framework Regularized by Global Consistency for Scribble Supervised Cardiac Segmentation

abstract: Cardiac segmentation is an essential step for the diagnosis of cardiovascular diseases. However, pixel-wise dense labeling is both costly and time-consuming. Scribble, as a form of sparse annotation, is more accessible than full annotations. However, it's particularly challenging to train a segmentation network with weak supervision from scribbles. To tackle this problem, we propose a new scribble-guided method for cardiac segmentation, based on the Positive-Unlabeled (PU) learning framework and global consistency regularization, and termed as ShapePU. To leverage unlabeled pixels via PU learning, we first present an Expectation-Maximization (EM) algorithm to estimate the proportion of each class in the unlabeled pixels. Given the estimated ratios, we then introduce the marginal probability maximization to identify the classes of unlabeled pixels. To exploit shape knowledge, we apply cutout operations to training images, and penalize the inconsistent segmentation results. Evaluated on two open datasets, i.e, ACDC and MSCMRseg, our scribble-supervised ShapePU surpassed the fully supervised approach respectively by 1.4% and 9.8% in average Dice, and outperformed the state-of-the-art weakly supervised and PU learning methods by large margins. Our code is available at https://github.com/BWGZK/ShapePU.


title: A Multimodal Corpus for Emotion Recognition in Sarcasm

abstract: While sentiment and emotion analysis have been studied extensively, the relationship between sarcasm and emotion has largely remained unexplored. A sarcastic expression may have a variety of underlying emotions. For example, "I love being ignored" belies sadness, while "my mobile is fabulous with a battery backup of only 15 minutes!" expresses frustration. Detecting the emotion behind a sarcastic expression is non-trivial yet an important task. We undertake the task of detecting the emotion in a sarcastic statement, which to the best of our knowledge, is hitherto unexplored. We start with the recently released multimodal sarcasm detection dataset (MUStARD) pre-annotated with 9 emotions. We identify and correct 343 incorrect emotion labels (out of 690). We double the size of the dataset, label it with emotions along with valence and arousal which are important indicators of emotional intensity. Finally, we label each sarcastic utterance with one of the four sarcasm types-Propositional, Embedded, Likeprefixed and Illocutionary, with the goal of advancing sarcasm detection research. Exhaustive experimentation with multimodal (text, audio, and video) fusion models establishes a benchmark for exact emotion recognition in sarcasm and outperforms the state-of-art sarcasm detection. We release the dataset enriched with various annotations and the code for research purposes: https://github.com/apoorva-nunna/MUStARD_Plus_Plus


title: MPANet: Multi-Patch Attention For Infrared Small Target object Detection

abstract: Infrared small target detection (ISTD) has attracted widespread attention and been applied in various fields. Due to the small size of infrared targets and the noise interference from complex backgrounds, the performance of ISTD using convolutional neural networks (CNNs) is restricted. Moreover, the constriant that long-distance dependent features can not be encoded by the vanilla CNNs also impairs the robustness of capturing targets' shapes and locations in complex scenarios. To this end, a multi-patch attention network (MPANet) based on the axial-attention encoder and the multi-scale patch branch (MSPB) structure is proposed. Specially, an axial-attention-improved encoder architecture is designed to highlight the effective features of small targets and suppress background noises. Furthermore, the developed MSPB structure fuses the coarse-grained and fine-grained features from different semantic scales. Extensive experiments on the SIRST dataset show the superiority performance and effectiveness of the proposed MPANet compared to the state-of-the-art methods.


title: Eigenvalues of weighted generalized shifts over direct products of vector spaces

abstract: In the following text for vector space $V$ over field $F$ we compute all eigenvalues of weighted generalized shift $\sigma_{\varphi,\mathfrak{w}}:V^\Gamma\to V^\Gamma$ (and generalized shift $\sigma_\varphi:V^\Gamma\to V^\Gamma$) for nonempty set $\Gamma$, weight vector $\mathfrak{w}\in F^\Gamma$ and self--map $\varphi:\Gamma\to \Gamma$.


title: Causal impact of severe events on electricity demand: The case of COVID-19 in Japan

abstract: As of May 2022, the coronavirus disease 2019 (COVID-19) still has a severe global impact on people's lives. Previous studies have reported that COVID-19 decreased the electricity demand in early 2020. However, our study found that the electricity demand increased in summer and winter even when the infection was widespread. The fact that the event has continued over two years suggests that it is essential to introduce the method which can estimate the impact of the event for long period considering seasonal fluctuations. We employed the Bayesian structural time-series model to estimate the causal impact of COVID-19 on electricity demand in Japan. The results indicate that behavioral restrictions due to COVID-19 decreased the daily electricity demand (-5.1% in weekdays, -6.1% in holidays) in April and May 2020 as indicated by previous studies. However, even in 2020, the results show that the demand increases in the hot summer and cold winter (the increasing rate is +14% in the period from 1st August to 15th September 2020, and +7.6% from 16th December 2020 to 15th January 2021). This study shows that the significant decrease in electricity demand for the business sector exceeded the increase in demand for the household sector in April and May 2020; however, the increase in demand for the households exceeded the decrease in demand for the business in hot summer and cold winter periods. Our result also implies that it is possible to run out of electricity when people's behavior changes even if they are less active.


title: On the volume of the Minkowski sum of zonoids

abstract: We explore some inequalities in convex geometry restricted to the class of zonoids. We show the equivalence, in the class of zonoids, between a local Alexandrov-Fenchel inequality, a local Loomis-Whitney inequality, the log-submodularity of volume, and the Dembo-Cover-Thomas conjecture on the monotonicity of the ratio of volume to the surface area. In addition to these equivalences, we confirm these conjectures in ${\mathbb R}^3$ and we establish an improved inequality in ${\mathbb R^2}$. Along the way, we give a negative answer to a question of Adam Marcus regarding the roots of the Steiner polynomial of zonoids. We also investigate analogous questions in the $L_p$-Brunn-Minkowski theory, and in particular, we confirm all of the above conjectures in the case $p=2$, in any dimension.


title: Sampling Frequency Independent Dialogue Separation

abstract: In some DNNs for audio source separation, the relevant model parameters are independent of the sampling frequency of the audio used for training. Considering the application of dialogue separation, this is shown for two DNN architectures: a U-Net and a fully-convolutional model. The models are trained with audio sampled at 8 kHz. The learned parameters are transferred to models for processing audio at 48 kHz. The separated audio sources are compared with the ones produced by the same model architectures trained with 48 kHz versions of the same training data. A listening test and computational measures show that there is no significant perceptual difference between the models trained with 8 kHz or with 48 kHz. This transferability of the learned parameters allows for a faster and computationally less costly training. It also enables using training datasets available at a lower sampling frequency than the one needed by the application at hand, or using data collections with multiple sampling frequencies.


title: Geometrically-Motivated Primary-Ambient Decomposition With Center-Channel Extraction

abstract: A geometrically-motivated method for primary-ambient decomposition is proposed and evaluated in an up-mixing application. The method consists of two steps, accommodating a particularly intuitive explanation. The first step consists of signal-adaptive rotations applied on the input stereo scene, which translate the primary sound sources into the center of the rotated scene. The second step applies a center-channel extraction method, based on a simple signal model and optimal in the mean-squared-error sense. The performance is evaluated by using the estimated ambient component to enable surround sound starting from real-world stereo signals. The participants in the reported listening test are asked to adjust the audio scene envelopment and find the audio settings that pleases them the most. The possibility for up-mixing enabled by the proposed method is used extensively, and the user satisfaction is significantly increased compared to the original stereo mix.


title: Learning Dynamics and Generalization in Reinforcement Learning

abstract: Solving a reinforcement learning (RL) problem poses two competing challenges: fitting a potentially discontinuous value function, and generalizing well to new observations. In this paper, we analyze the learning dynamics of temporal difference algorithms to gain novel insight into the tension between these two objectives. We show theoretically that temporal difference learning encourages agents to fit non-smooth components of the value function early in training, and at the same time induces the second-order effect of discouraging generalization. We corroborate these findings in deep RL agents trained on a range of environments, finding that neural networks trained using temporal difference algorithms on dense reward tasks exhibit weaker generalization between states than randomly initialized networks and networks trained with policy gradient methods. Finally, we investigate how post-training policy distillation may avoid this pitfall, and show that this approach improves generalization to novel environments in the ProcGen suite and improves robustness to input perturbations.


title: DeeprETA: An ETA Post-processing System at Scale

abstract: Estimated Time of Arrival (ETA) plays an important role in delivery and ride-hailing platforms. For example, Uber uses ETAs to calculate fares, estimate pickup times, match riders to drivers, plan deliveries, and more. Commonly used route planning algorithms predict an ETA conditioned on the best available route, but such ETA estimates can be unreliable when the actual route taken is not known in advance. In this paper, we describe an ETA post-processing system in which a deep residual ETA network (DeeprETA) refines naive ETAs produced by a route planning algorithm. Offline experiments and online tests demonstrate that post-processing by DeeprETA significantly improves upon the accuracy of naive ETAs as measured by mean and median absolute error. We further show that post-processing by DeeprETA attains lower error than competitive baseline regression models.


title: Probing inside a charged hairy black hole in massive gravity

abstract: In this paper, we investigate the internal structure of a charged hairy black hole solution in the non-linear massive gravity. We first consider the impact of various configurations of massive gravity on the condensate operator and then probe the black hole interior dynamics. Like a standard holographic superconductor system, just below the critical temperature, the interior evolves through several distinct epochs, including a collapse of the Einstein-Rosen bridge, Josephson oscillations of the scalar field, and finally a Kasner (or Kasner inversion) cosmology. However, for the large massive gravity parameter, we see distinguishing features for the interior dynamics. In this regime, at a given temperature, the Einstein-Rosen bridge collapse and subsequent Josephson oscillations epochs completely disappear from the interior dynamics and the final Kasner cosmology epoch starts exactly after the would-be inner horizon and the system does not experience the Kasner inversion epoch.


title: Three Cases of Optical Periodic Modulation in Active Galactic Nuclei

abstract: We report on the case of optical periodic modulation discovered in two Active Galactic Nuclei (AGN) and one candidate AGN. Analyzing the archival optical data obtained from large transient surveys, namely the Catalina Real-Transient Survey (CRTS) and the Zwicky Transient Facility (ZTF), we find periodicities of 2169.7, 2103.1, and 1462.6\,day in sources J0122+1032, J1007+1248 (or PG~1004+1248), and J2131$-$1127, respectively. The optical spectra of the first two indicate that the first is likely a blazar and the second a type 1 Seyfert galaxy, and while no spectroscopic information is available for the third one, its overall properties suggest that it is likely an AGN. In addition, mid-infrared (MIR) light curve data of the three sources, taken by the Wide-field InfraredSurvey Explorer (WISE), are also analyzed. The light curves show significant variations, but not appearing related to the optical periodicities. Based on the widely-discussed super-massive black-hole binary (SMBHB) scenario, we discuss the origin of the optical modulation. Two possible interesting features, an additional 162-day short optical periodicity in J2131$-$1127 and the consistency the X-ray flux variations of J1007+1248 with its optical periodicity, are also discussed within the SMBHB scenario.


title: Towards a unified interpretation of the early Universe in $R^2$-corrected dark energy model of $F(R)$ gravity

abstract: $R^2$-corrected dark energy (DE) models in $F(R)$ gravity have been widely investigated in recent years, which not only removes the weak singularity potentially present in DE models but also provide us with a unified picture of the cosmic history, including the inflationary and DE epochs. Towards the unified interpretation of dynamical DE all over the cosmic history in the class of $R^2$-corrected DE models, we explore the universal features of the scalaron dynamics in the radiation-dominated epoch, along with the chameleon mechanism, by keeping our eyes on the inflationary and DE epochs. We show that the scalaron evolution does not follow a \textit{surfing solution} and is mostly adiabatic before big bang nucleosynthesis (BBN), even properly including the \textit{kick} by the nonperturbative QCD phase transition, hence a catastrophic consequence claimed in the literature is not applied to this class of DE models. This is due to the presence of the gigantic scale hierarchy between $R^2$ correction and DE, so is the universal feature for the class of $R^2$-corrected DE models. The prospects for the post- or onset-inflationary epoch would be pretty different from what the standard $R^2$ inflationary scenario undergoes due to the presence of the chameleon mechanism.


title: Federated Adversarial Training with Transformers

abstract: Federated learning (FL) has emerged to enable global model training over distributed clients' data while preserving its privacy. However, the global trained model is vulnerable to the evasion attacks especially, the adversarial examples (AEs), carefully crafted samples to yield false classification. Adversarial training (AT) is found to be the most promising approach against evasion attacks and it is widely studied for convolutional neural network (CNN). Recently, vision transformers have been found to be effective in many computer vision tasks. To the best of the authors' knowledge, there is no work that studied the feasibility of AT in a FL process for vision transformers. This paper investigates such feasibility with different federated model aggregation methods and different vision transformer models with different tokenization and classification head techniques. In order to improve the robust accuracy of the models with the not independent and identically distributed (Non-IID), we propose an extension to FedAvg aggregation method, called FedWAvg. By measuring the similarities between the last layer of the global model and the last layer of the client updates, FedWAvg calculates the weights to aggregate the local models updates. The experiments show that FedWAvg improves the robust accuracy when compared with other state-of-the-art aggregation methods.