title: Geometric phase and non-adiabatic resonance of the Rabi model

abstract: We investigate the effects of counterrotating terms on geometric phase and its relation to the resonance of the Rabi model. We apply the unitary transformation with a single parameter to the Rabi model and obtain the transformed Hamiltonian involving multiple harmonic terms. By combining the counter-rotating-hybridized rotating-wave method with time-dependent perturbation theory, we solve systematically time evolution operator and then obtain the geometric phase of the two-level system. Our results are beyond adiabatic approximation and rotating-wave approximation (RWA). Higher-order harmonic resonance happens when driving frequency is equal to higher-order subharmonic of the Rabi frequency. In comparison with numerically exact results, our calculated results are accurate over a wide range of parameters space, especially in higher-order harmonic resonance regimes. In these regimes we demonstrate geometric phases change dramatically while those of the RWA are smooth. The RWA is thoroughly invalid even if the driving strength is extremely weak. We find it is the higher-order harmonic terms that play an important role on the cyclic state and demonstrate the characters of geometric phase in higher-order harmonic resonance regime. We also present analytical formalism of the change rate of geometric phase and quasienergies, which agree well with numerically exact ones even in the strong driving case. The developed method can be applied to explore the dynamics of strongly driven qubits and physical properties of higher-order harmonic processes.


title: TLDR9+: A Large Scale Resource for Extreme Summarization of Social Media Posts

abstract: Recent models in developing summarization systems consist of millions of parameters and the model performance is highly dependent on the abundance of training data. While most existing summarization corpora contain data in the order of thousands to one million, generation of large-scale summarization datasets in order of couple of millions is yet to be explored. Practically, more data is better at generalizing the training patterns to unseen data. In this paper, we introduce TLDR9+ -- a large-scale summarization dataset -- containing over 9 million training instances extracted from Reddit discussion forum (https://github.com/sajastu/reddit_collector). This dataset is specifically gathered to perform extreme summarization (i.e., generating one-sentence summary in high compression and abstraction) and is more than twice larger than the previously proposed dataset. We go one step further and with the help of human annotations, we distill a more fine-grained dataset by sampling High-Quality instances from TLDR9+ and call it TLDRHQ dataset. We further pinpoint different state-of-the-art summarization models on our proposed datasets.


title: Beyond Topics: Discovering Latent Healthcare Objectives from Event Sequences

abstract: A meaningful understanding of clinical protocols and patient pathways helps improve healthcare outcomes. Electronic health records (EHR) reflect real-world treatment behaviours that are used to enhance healthcare management but present challenges; protocols and pathways are often loosely defined and with elements frequently not recorded in EHRs, complicating the enhancement. To solve this challenge, healthcare objectives associated with healthcare management activities can be indirectly observed in EHRs as latent topics. Topic models, such as Latent Dirichlet Allocation (LDA), are used to identify latent patterns in EHR data. However, they do not examine the ordered nature of EHR sequences, nor do they appraise individual events in isolation. Our novel approach, the Categorical Sequence Encoder (CaSE) addresses these shortcomings. The sequential nature of EHRs is captured by CaSE's event-level representations, revealing latent healthcare objectives. In synthetic EHR sequences, CaSE outperforms LDA by up to 37% at identifying healthcare objectives. In the real-world MIMIC-III dataset, CaSE identifies meaningful representations that could critically enhance protocol and pathway development.


title: Enhance Images as You Like with Unpaired Learning

abstract: Low-light image enhancement exhibits an ill-posed nature, as a given image may have many enhanced versions, yet recent studies focus on building a deterministic mapping from input to an enhanced version. In contrast, we propose a lightweight one-path conditional generative adversarial network (cGAN) to learn a one-to-many relation from low-light to normal-light image space, given only sets of low- and normal-light training images without any correspondence. By formulating this ill-posed problem as a modulation code learning task, our network learns to generate a collection of enhanced images from a given input conditioned on various reference images. Therefore our inference model easily adapts to various user preferences, provided with a few favorable photos from each user. Our model achieves competitive visual and quantitative results on par with fully supervised methods on both noisy and clean datasets, while being 6 to 10 times lighter than state-of-the-art generative adversarial networks (GANs) approaches.


title: Controlling Resource Allocation using Blockchain-Based Delegation

abstract: Allocation of resources and their control over multiple organisations is challenging. This is especially true for a large-scale and dynamic system like the Internet of Things (IoT). One of the core issues in such a system is the provision of secure access control. In particular, transfer of access rights from one entity to another in a secure, flexible and fine-grained manner. In this paper, we present a multi-organisational delegation framework using blockchain. Our framework takes advantage of blockchain smart contracts to define the interactions and resource allocation between the consortium of organisations. We show the feasibility of our solution in a real-world scenario using the allocation of transportation credits in a multi-level organisational setting as a use-case. We provide proof of implementation of the proposed framework using the Hyperledger Fabric blockchain platform. Our results indicate that the proposed framework is efficient and can be used for city-wide transport, potentially even scale country-wide with a shared blockchain with complex access control rules. It also bestows better transparency to the delegation of access rights and control over the employees' transportation access for the organisations.


title: Effective Bounds for the Decay of Schr\"odinger Eigenfunctions and Agmon bubbles

abstract: We study solutions of $-\Delta u + V u = \lambda u$ on $\mathbb{R}^n$. Such solutions localize in the `allowed' region $\left\{x \in \mathbb{R}^n: V(x) \leq \lambda\right\}$ and decay exponentially in the `forbidden' region $\left\{x \in \mathbb{R}^n: V(x) > \lambda\right\}$. One way of making this precise is Agmon's inequality implying decay estimates in terms of the Agmon metric. We prove a complementary decay estimate in terms of harmonic measure which can improve on Agmon's estimate, connect the Agmon metric to decay of harmonic measure and prove a sharp pointwise Agmon estimate.


title: Decoupling Speaker-Independent Emotions for Voice Conversion Via Source-Filter Networks

abstract: Emotional voice conversion (VC) aims to convert a neutral voice to an emotional (e.g. happy) one while retaining the linguistic information and speaker identity. We note that the decoupling of emotional features from other speech information (such as speaker, content, etc.) is the key to achieving remarkable performance. Some recent attempts about speech representation decoupling on the neutral speech can not work well on the emotional speech, due to the more complex acoustic properties involved in the latter. To address this problem, here we propose a novel Source-Filter-based Emotional VC model (SFEVC) to achieve proper filtering of speaker-independent emotion features from both the timbre and pitch features. Our SFEVC model consists of multi-channel encoders, emotion separate encoders, and one decoder. Note that all encoder modules adopt a designed information bottlenecks auto-encoder. Additionally, to further improve the conversion quality for various emotions, a novel two-stage training strategy based on the 2D Valence-Arousal (VA) space was proposed. Experimental results show that the proposed SFEVC along with a two-stage training strategy outperforms all baselines and achieves the state-of-the-art performance in speaker-independent emotional VC with nonparallel data.


title: DESTRESS: Computation-Optimal and Communication-Efficient Decentralized Nonconvex Finite-Sum Optimization

abstract: Emerging applications in multi-agent environments such as internet-of-things, networked sensing, autonomous systems and federated learning, call for decentralized algorithms for finite-sum optimizations that are resource-efficient in terms of both computation and communication. In this paper, we consider the prototypical setting where the agents work collaboratively to minimize the sum of local loss functions by only communicating with their neighbors over a predetermined network topology. We develop a new algorithm, called DEcentralized STochastic REcurSive gradient methodS (DESTRESS) for nonconvex finite-sum optimization, which matches the optimal incremental first-order oracle (IFO) complexity of centralized algorithms for finding first-order stationary points, while maintaining communication efficiency. Detailed theoretical and numerical comparisons corroborate that the resource efficiencies of DESTRESS improve upon prior decentralized algorithms over a wide range of parameter regimes. DESTRESS leverages several key algorithm design ideas including randomly activated stochastic recursive gradient updates with mini-batches for local computation, gradient tracking with extra mixing (i.e., multiple gossiping rounds) for per-iteration communication, together with careful choices of hyper-parameters and new analysis frameworks to provably achieve a desirable computation-communication trade-off.


title: Retrospective clinical evaluation of a decision-support software for adaptive radiotherapy of Head & Neck cancer patients

abstract: Purpose: To evaluate the clinical need for automated decision-support platforms for Adaptive Radiotherapy Therapy (ART) of Head & Neck cancer (HNC) patients. Methods: We tested RTapp (SegAna), a new decision-support software for ART, to investigate 22 HNC patients data retrospectively. For each fraction, RTapp estimated the daily and cumulative doses received by targets and OARs from daily 3D imaging in real-time. RTapp also included a prediction algorithm that analyzed dosimetric parameters (DP) trends against dosimetric endpoints (DE) to trigger adaptation up to 4 fractions ahead. Warning (V95<95%) and adaptation (V95<93%) DEs were set for PTVs. OAR adaptation DEs of +10% (DE10) were set for all Dmax and Dmean DPs. Any DE violation at end of treatment (EOT) triggered a DP trends review to determine the DE-crossing fraction Fx and evaluate the prediction model accuracy (difference between calculated and predicted DP values with 95% confidence intervals). Results: RTapp was able to address the needs of treatment adaptation. 15/22 studies (68%) violated PTV coverage or parotids Dmean at EOT. 9 PTVs had V95<95% (mean coverage decrease of -7.7+/-3.3 %) including 4 flagged for adaptation at median Fx=11.5 (range: 6-18). 15 parotids were flagged for exceeding Dmean constraints with median increase of +3.18 Gy (range: 0.18-6.31 Gy) at EOT, including 8 with DP>DE10. The differences between predicted and calculated PTV V95 and parotids Dmean was up to 7.6% (mean: -2.9+/-4.6 %) and 5 Gy (mean: 0.2+/-1.6 Gy), respectively. The most accurate predictions were obtained closest to Fx. For parotids, Fx ranged between fractions 1 to 23, the lack of specific trend demonstrated the need to verify treatment adaptation for every fraction. Conclusion: Integrated in an ART clinical workflow, RTapp can predict whether specific treatment would require adaptation up to 4 fractions ahead of time.


title: Trustworthy AI: From Principles to Practices

abstract: The rapid development of Artificial Intelligence (AI) technology has enabled the deployment of various systems based on it. However, many current AI systems are found vulnerable to imperceptible attacks, biased against underrepresented groups, lacking in user privacy protection. These shortcomings degrade user experience and erode people's trust in all AI systems. In this review, we provide AI practitioners with a comprehensive guide for building trustworthy AI systems. We first introduce the theoretical framework of important aspects of AI trustworthiness, including robustness, generalization, explainability, transparency, reproducibility, fairness, privacy preservation, and accountability. To unify currently available but fragmented approaches toward trustworthy AI, we organize them in a systematic approach that considers the entire lifecycle of AI systems, ranging from data acquisition to model development, to system development and deployment, finally to continuous monitoring and governance. In this framework, we offer concrete action items for practitioners and societal stakeholders (e.g., researchers, engineers, and regulators) to improve AI trustworthiness. Finally, we identify key opportunities and challenges for the future development of trustworthy AI systems, where we identify the need for a paradigm shift toward comprehensively trustworthy AI systems.


title: BLEnD: Improving NDN Performance Over Wireless Links Using Interest Bundling

abstract: Named Data Networking (NDN) employs small-sized Interest packets to retrieve large-sized Data packets. Given the half-duplex nature of wireless links, Interest packets frequently contend for the channel with Data packets, leading to throughput degradation. In this work, we present a novel idea called BLEnD, an Interest-bundling technique that encodes multiple Interests into one at the sender and decodes at the receiver. The major design challenges are to reduce the number of Interest transmissions without impacting the one-Interest one-Data principle embedded everywhere in NDN architecture and implementation, and support flow/congestion control mechanisms that usually use Interest packets as signals. BLEnD achieves these by bundling/unbundling Interests at the link adaptation layer, keeping all NDN components unaware and unaffected. Over a one-hop WiFi link, BLEnD improves application throughput by 30%. It may also be used over multiple hops and be improved in a number of ways.


title: The effects of magnetic fields on magnetic dipole moments

abstract: We calculate the effect of magnetic fields on the magnetic dipole moment of leptons up to the quadratic order in the magnetic field, including the QCD contributions. Since the leading contribution, which is linear in the magnetic field, depends on the spin, its effect is not measurable directly in the Penning trap experiment for the electron dipole moment. In the muon anomaly, however, we find that the electrons decayed from muons are refracted linearly in the magnetic field. This effect, though quite small, changes the distribution of the detected electrons in the muon $g-2$ experiment and could be measurable, improving the experimental uncertainties. We also discuss the general field-dependent form factors and the Ward-Takahashi identity under the external magnetic fields.


title: Graph-based multiple change-point detection

abstract: We propose a new multiple change-point detection framework for multivariate and non-Euclidean data. First, we combine graph-based statistics with wild binary segmentation or seeded binary segmentation to search for a pool of candidate change-points. We then prune the candidate change-points through a novel goodness-of-fit statistic. Numerical studies show that this new framework outperforms existing methods under a wide range of settings. The resulting change-points can further be arranged hierarchically based on the goodness-of-fit statistic. The new framework is illustrated on a Neuropixels recording of an awake mouse.


title: Deep Fraud Detection on Non-attributed Graph

abstract: Fraud detection problems are usually formulated as a machine learning problem on a graph. Recently, Graph Neural Networks (GNNs) have shown solid performance on fraud detection. The successes of most previous methods heavily rely on rich node features and high-fidelity labels. However, labeled data is scarce in large-scale industrial problems, especially for fraud detection where new patterns emerge from time to time. Meanwhile, node features are also limited due to privacy and other constraints. In this paper, two improvements are proposed: 1) We design a graph transformation method capturing the structural information to facilitate GNNs on non-attributed fraud graphs. 2) We propose a novel graph pre-training strategy to leverage more unlabeled data via contrastive learning. Experiments on a large-scale industrial dataset demonstrate the effectiveness of the proposed framework for fraud detection.


title: A New Acceleration Paradigm for Discrete CosineTransform and Other Fourier-Related Transforms

abstract: Discrete cosine transform (DCT) and other Fourier-related transforms have broad applications in scientific computing. However, off-the-shelf high-performance multi-dimensional DCT (MD DCT) libraries are not readily available in parallel computing systems. Public MD DCT implementations leverage a straightforward method that decomposes the computation into multiple 1D DCTs along every single dimension, which inevitably has non-optimal performance due to low computational efficiency, parallelism, and locality. In this paper, we propose a new acceleration paradigm for MD DCT. A three-stage procedure is proposed to factorize MD DCT into MD FFT and highly-optimized preprocessing/postprocessing with efficient computation and high arithmetic intensity. Our paradigm can be easily extended to other Fourier-related transforms and other parallel computing systems. Experimental results show that our 2D DCT/IDCT CUDA implementation has a stable, FFT-comparable execution time, which is $2\times$ faster than the previous row-column method. Several case studies demonstrate that a promising efficiency improvement can be achieved with our paradigm. The implementations are available at https://github.com/JeremieMelo/dct_cuda/tree/reconstruct.


title: Bipartite 3-Regular Counting Problems with Mixed Signs

abstract: We prove a complexity dichotomy for a class of counting problems expressible as bipartite 3-regular Holant problems. For every problem of the form $\operatorname{Holant}\left(f\mid =_3 \right)$, where $f$ is any integer-valued ternary symmetric constraint function on Boolean variables, we prove that it is either P-time computable or #P-hard, depending on an explicit criterion of $f$. The constraint function can take both positive and negative values, allowing for cancellations. The dichotomy extends easily to rational valued functions of the same type. In addition, we discover a new phenomenon: there is a set $\mathcal{F}$ with the property that for every $f \in \mathcal{F}$ the problem $\operatorname{Holant}\left(f\mid =_3 \right)$ is planar P-time computable but #P-hard in general, yet its planar tractability is by a combination of a holographic transformation by $\left[\begin{smallmatrix} 1 & 1 \\ 1 & -1 \end{smallmatrix}\right]$ to FKT together with an independent global argument.


title: Deep Kernel Representation for Image Reconstruction in PET

abstract: Image reconstruction for positron emission tomography (PET) is challenging because of the ill-conditioned tomographic problem and low counting statistics. Kernel methods address this challenge by using kernel representation to incorporate image prior information in the forward model of iterative PET image reconstruction. Existing kernel methods construct the kernels commonly using an empirical process, which may lead to unsatisfactory performance. In this paper, we describe the equivalence between the kernel representation and a trainable neural network model. A deep kernel method is then proposed by exploiting a deep neural network to enable automated learning of an improved kernel model and is directly applicable to single subjects in dynamic PET. The training process utilizes available image prior data to form a set of robust kernels in an optimized way rather than empirically. The results from computer simulations and a real patient dataset demonstrate that the proposed deep kernel method can outperform the existing kernel method and neural network method for dynamic PET image reconstruction.


title: An Unconditionally Stable Conformal LOD-FDTD Method For Curved PEC Objects and Its Application to EMC Problems

abstract: The traditional finite-difference time-domain (FDTD) method is constrained by the Courant-Friedrich-Levy (CFL) condition and suffers from the notorious staircase error in electromagnetic simulations. This paper proposes a three-dimensional conformal locally-one-dimensional FDTD (CLOD-FDTD) method to address the two issues for modeling perfectly electrical conducting (PEC) objects. By considering the partially filled cells, the proposed CLOD-FDTD method can significantly improve the accuracy compared with the traditional LOD-FDTD method and the FDTD method. At the same time, the proposed method preserves unconditional stability, which is analyzed and numerically validated using the Von-Neuman method. Significant gains in Central Processing Unit (CPU) time are achieved by using large time steps without sacrificing accuracy. Two numerical examples include a PEC cylinder and a missile are used to verify its accuracy and efficiency with different meshes and time steps. It can be found from these examples, the CLOD-FDTD method show better accuracy and can improve the efficiency compared with those of the traditional FDTD method and the traditional LOD-FDTD method.


title: Contextualized Semantic Distance between Highly Overlapped Texts

abstract: Overlapping frequently occurs in paired texts in natural language processing tasks like text editing and semantic similarity evaluation. Better evaluation of the semantic distance between the overlapped sentences benefits the language system's understanding and guides the generation. Since conventional semantic metrics are based on word representations, they are vulnerable to the disturbance of overlapped components with similar representations. This paper aims to address the issue with a mask-and-predict strategy. We take the words in the longest common sequence (LCS) as neighboring words and use masked language modeling (MLM) from pre-trained language models (PLMs) to predict the distributions on their positions. Our metric, Neighboring Distribution Divergence (NDD), represent the semantic distance by calculating the divergence between distributions in the overlapped parts. Experiments on Semantic Textual Similarity show NDD to be more sensitive to various semantic differences, especially on highly overlapped paired texts. Based on the discovery, we further implement an unsupervised and training-free method for text compression, leading to a significant improvement on the previous perplexity-based method. The high scalability of our method even enables NDD to outperform the supervised state-of-the-art in domain adaption by a huge margin. Further experiments on syntax and semantics analyses verify the awareness of internal sentence structures, indicating the high potential of NDD for further studies.


title: The Second DiCOVA Challenge: Dataset and performance analysis for COVID-19 diagnosis using acoustics

abstract: The Second Diagnosis of COVID-19 using Acoustics (DiCOVA) Challenge aimed at accelerating the research in acoustics based detection of COVID-19, a topic at the intersection of acoustics, signal processing, machine learning, and healthcare. This paper presents the details of the challenge, which was an open call for researchers to analyze a dataset of audio recordings consisting of breathing, cough and speech signals. This data was collected from individuals with and without COVID-19 infection, and the task in the challenge was a two-class classification. The development set audio recordings were collected from 965 (172 COVID-19 positive) individuals, while the evaluation set contained data from 471 individuals (71 COVID-19 positive). The challenge featured four tracks, one associated with each sound category of cough, speech and breathing, and a fourth fusion track. A baseline system was also released to benchmark the participants. In this paper, we present an overview of the challenge, the rationale for the data collection and the baseline system. Further, a performance analysis for the systems submitted by the $16$ participating teams in the leaderboard is also presented.


title: High Temperature Superconductivity in the Candidate Phases of Solid Hydrogen

abstract: As the simplest element in nature, unraveling the phase diagram of hydrogen is a primary task for condensed matter physics. As conjectured many decades ago, in the low-temperature and high-pressure part of the phase diagram, solid hydrogen is expected to become metallic with a high superconducting transition temperature. The metallization may occur via band gap closure in the molecular solid or via a transition to the atomic solid. Recently, a few experimental studies pushed the achievable pressures into the 400 - 500 GPa range. There are strong indications that at some pressure in this range metallization via either of these mechanisms occurs, although there are disagreements between experimental reports. Furthermore, there are multiple good candidate crystal phases that have emerged from recent computational and experimental studies which may be realized in upcoming experiments. Therefore, it is crucial to determine the superconducting properties of these candidate phases. In a recent study, we reported the superconducting properties of the C2/c-24 phase, which we believe to be a strong candidate for metallization via band gap closure [M. Dogan et al., arXiv:2107.03889 (2021)]. Here, we report the superconducting properties of the Cmca-12, Cmca-4 and I41/amd-2 phases including the anharmonic effects using a Wannier function-based dense k-point and q-point sampling. We find that the Cmca-12 phase has a superconducting transition temperature that rises from 86 K at 400 GPa to 212 K at 500 GPa, whereas the Cmca-4 and I41/amd-2 phases show a less pressure-dependent behavior with their Tc in the 74 - 94 K and 307 - 343 K ranges, respectively. These properties can be used to distinguish between crystal phases in future experiments. Understanding superconductivity in pure hydrogen is also important in the study of high-Tc hydrides.


title: BPFNet: A Unified Framework for Bimodal Palmprint Alignment and Fusion

abstract: Bimodal palmprint recognition leverages palmprint and palm vein images simultaneously,which achieves high accuracy by multi-model information fusion and has strong anti-falsification property. In the recognition pipeline, the detection of palm and the alignment of region-of-interest (ROI) are two crucial steps for accurate matching. Most existing methods localize palm ROI by keypoint detection algorithms, however the intrinsic difficulties of keypoint detection tasks make the results unsatisfactory. Besides, the ROI alignment and fusion algorithms at image-level are not fully investigaged.To bridge the gap, in this paper, we propose Bimodal Palmprint Fusion Network (BPFNet) which focuses on ROI localization, alignment and bimodal image fusion.BPFNet is an end-to-end framework containing two subnets: The detection network directly regresses the palmprint ROIs based on bounding box prediction and conducts alignment by translation estimation.In the downstream,the bimodal fusion network implements bimodal ROI image fusion leveraging a novel proposed cross-modal selection scheme. To show the effectiveness of BPFNet,we carry out experiments on the large-scale touchless palmprint datasets CUHKSZ-v1 and TongJi and the proposed method achieves state-of-the-art performances.


title: Graphs with disjoint cycles, classification via the talented monoid

abstract: We characterise directed graphs consisting of disjoint cycles via their talented monoids. We show that a graph $E$ consists of disjoint cycles precisely when its talented monoid $T_E$ has a certain Jordan-H\"older composition series. These are graphs whose associated Leavitt path algebras have finite Gelfand-Kirillov dimension (GKdim). We show that this dimension can be determined as the length of certain ideal series of the talented monoid. Since $T_E$ is the positive cone of the graded Grothendieck group $K_0^{gr}(L_K (E))$, we conclude that for graphs $E$ and $F$, if $K_0^{gr}(L_K (E))\cong K_0^{gr}(L_K (F))$ then $GKdim L_K(E) = GKdim L_K(F)$, thus providing more evidence for the Graded Classification Conjecture for Leavitt path algebras.


title: FM-Indexing Grammars Induced by Suffix Sorting for Long Patterns

abstract: The run-length compressed Burrows-Wheeler transform (RLBWT) used in conjunction with the backward search introduced in the FM index is the centerpiece of most compressed indexes working on highly-repetitive data sets like biological sequences. Compared to grammar indexes, the size of the RLBWT is often much bigger, but queries like counting the occurrences of long patterns can be done much faster than on any existing grammar index so far. In this paper, we combine the virtues of a grammar with the RLBWT by building the RLBWT on top of a special grammar based on induced suffix sorting. Our experiments reveal that our hybrid approach outperforms the classic RLBWT with respect to the index sizes, and with respect to query times on biological data sets for sufficiently long patterns.


title: Differentiable 3D CAD Programs for Bidirectional Editing

abstract: Modern CAD tools represent 3D designs not only as geometry, but also as a program composed of geometric operations, each of which depends on a set of parameters. Program representations enable meaningful and controlled shape variations via parameter changes. However, achieving desired modifications solely through parameter editing is challenging when CAD models have not been explicitly authored to expose select degrees of freedom in advance. We introduce a novel bidirectional editing system for 3D CAD programs. In addition to editing the CAD program, users can directly manipulate 3D geometry and our system infers parameter updates to keep both representations in sync. We formulate inverse edits as a set of constrained optimization objectives, returning plausible updates to program parameters that both match user intent and maintain program validity. Our approach implements an automatically differentiable domain-specific language for CAD programs, providing derivatives for this optimization to be performed quickly on any expressed program. Our system enables rapid, interactive exploration of a constrained 3D design space by allowing users to manipulate the program and geometry interchangeably during design iteration. While our approach is not designed to optimize across changes in geometric topology, we show it is expressive and performant enough for users to produce a diverse set of design variants, even when the CAD program contains a large number of parameters.


title: Examining Similar and Ideologically Correlated Imagery in Online Political Communication

abstract: This paper investigates visual media shared by US national politicians on Twitter, how a politician's variety of image types shared reflects their political position, and identifies a hazard in using standard methods for image characterization in this context. While past work has yielded valuable results on politicians' use of imagery in social media, that work has focused primarily on photographic media, which may be insufficient given the variety of visual media shared in such spaces (e.g., infographics, illustrations, or memes). Leveraging multiple popular, pre-trained, deep-learning models to characterize politicians' visuals, this work uses clustering to identify eight types of visual media shared on Twitter, several of which are not photographic in nature. Results show individual politicians share a variety of these types, and the distributions of their imagery across these clusters is correlated with their overall ideological position -- e.g., liberal politicians appear to share a larger proportion of infographic-style images, and conservative politicians appear to share more patriotic imagery. Manual assessment, however, reveals that these image-characterization models often group visually similar images with different semantic meaning into the same clusters, which has implications for how researchers interpret clusters in this space and cluster-based correlations with political ideology. In particular, collapsing semantic meaning in these pre-trained models may drive null findings on certain clusters of images rather than politicians across the ideological spectrum sharing common types of imagery. We end this paper with a set of researcher recommendations to prevent such issues.


title: Book free $3$-Uniform Hypergraphs

abstract: A $k$-book in a hypergraph consists of $k$ Berge triangles sharing a common edge. In this paper we prove that the number of the hyperedges in a $k$-book-free 3-uniform hypergraph on $n$ vertices is at most $\frac{n^2}{8}(1+o(1))$.


title: Improving Axial-Attention Network Classification via Cross-Channel Weight Sharing

abstract: In recent years, hypercomplex-inspired neural networks (HCNNs) have been used to improve deep learning architectures due to their ability to enable channel-based weight sharing, treat colors as a single entity, and improve representational coherence within the layers. The work described herein studies the effect of replacing existing layers in an Axial Attention network with their representationally coherent variants to assess the effect on image classification. We experiment with the stem of the network, the bottleneck layers, and the fully connected backend, by replacing them with representationally coherent variants. These various modifications lead to novel architectures which all yield improved accuracy performance on the ImageNet300k classification dataset. Our baseline networks for comparison were the original real-valued ResNet, the original quaternion-valued ResNet, and the Axial Attention ResNet. Since improvement was observed regardless of which part of the network was modified, there is a promise that this technique may be generally useful in improving classification accuracy for a large class of networks.


title: Text-based automatic personality prediction: A bibliographic review

abstract: Personality detection is an old topic in psychology and Automatic Personality Prediction (or Perception) (APP) is the automated (computationally) forecasting of the personality on different types of human generated/exchanged contents (such as text, speech, image, video). The principal objective of this study is to offer a shallow (overall) review of natural language processing approaches on APP since 2010. With the advent of deep learning and following it transfer-learning and pre-trained model in NLP, APP research area has been a hot topic, so in this review, methods are categorized into three; pre-trained independent, pre-trained model based, multimodal approaches. Also, to achieve a comprehensive comparison, reported results are informed by datasets.


title: On the treatment of phenomenological turbulent effects in one dimensional simulations of core-collapse supernovae

abstract: We have developed a phenomenological turbulent model with one-dimensional (1D) simulation based on Reynolds decomposition. Using this method, we have systematically studied models with different effects of compression, mixing length parameters, and diffusion coefficient of internal energy, turbulence energy and electron fraction. With employed turbulent effects, supernova explosion can be achieved in 1D geometry, which can mimic the evolution of shock in the 3D simulations. We found that enhancement of turbulent energy by compression affects the early shock evolution. The diffusion coefficients of internal energy and turbulent energy also affect the explodability. The smaller diffusion makes the shock revival faster. Our comparison between the two reveals that the diffusion coefficients of internal energy has a greater impact. These simulations would help understand the role of turbulence in core-collapse supernovae.


title: LawSum: A weakly supervised approach for Indian Legal Document Summarization

abstract: Unlike the courts in western countries, public records of Indian judiciary are completely unstructured and noisy. No large scale publicly available annotated datasets of Indian legal documents exist till date. This limits the scope for legal analytics research. In this work, we propose a new dataset consisting of over 10,000 judgements delivered by the supreme court of India and their corresponding hand written summaries. The proposed dataset is pre-processed by normalising common legal abbreviations, handling spelling variations in named entities, handling bad punctuations and accurate sentence tokenization. Each sentence is tagged with their rhetorical roles. We also annotate each judgement with several attributes like date, names of the plaintiffs, defendants and the people representing them, judges who delivered the judgement, acts/statutes that are cited and the most common citations used to refer the judgement. Further, we propose an automatic labelling technique for identifying sentences which have summary worthy information. We demonstrate that this auto labeled data can be used effectively to train a weakly supervised sentence extractor with high accuracy. Some possible applications of this dataset besides legal document summarization can be in retrieval, citation analysis and prediction of decisions by a particular judge.


title: Volatility prediction comparison via robust volatility proxies: An empirical deviation perspective

abstract: Volatility forecasting is crucial to risk management and portfolio construction. One particular challenge of assessing volatility forecasts is how to construct a robust proxy for the unknown true volatility. In this work, we show that the empirical loss comparison between two volatility predictors hinges on the deviation of the volatility proxy from the true volatility. We then establish non-asymptotic deviation bounds for three robust volatility proxies, two of which are based on clipped data, and the third of which is based on exponentially weighted Huber loss minimization. In particular, in order for the Huber approach to adapt to non-stationary financial returns, we propose to solve a tuning-free weighted Huber loss minimization problem to jointly estimate the volatility and the optimal robustification parameter at each time point. We then inflate this robustification parameter and use it to update the volatility proxy to achieve optimal balance between the bias and variance of the global empirical loss. We also extend this Huber method to construct volatility predictors. Finally, we exploit the proposed robust volatility proxy to compare different volatility predictors on the Bitcoin market data. It turns out that when the sample size is limited, applying the robust volatility proxy gives more consistent and stable evaluation of volatility forecasts.


title: Generalized Fractional Birth Process

abstract: In this paper, we introduce a generalized birth process (GBP) which performs jumps of size $1,2,\dots,k$ whose rates depend on the state of the process at time $t\geq0$. We derive a non-exploding condition for it. The system of differential equations that governs its state probabilities is obtained. In this governing system of differential equations, we replace the first order derivative with Caputo fractional derivative to obtain a fractional variant of the GBP, namely, the generalized fractional birth process (GFBP). The Laplace transform of the state probabilities of this fractional variant is obtained whose inversion yields its one-dimensional distribution. It is shown that the GFBP is equal in distribution to a time-changed version of the GBP, and this result is used to obtain a non-exploding condition for it. A limiting case of the GFBP is considered in which jump of any size $j\ge1$ is possible. Also, we discuss a state dependent version of it.


title: Molformer: Motif-based Transformer on 3D Heterogeneous Molecular Graphs

abstract: Procuring expressive molecular representations underpins AI-driven molecule design and scientific discovery. The research mainly focuses on atom-level homogeneous molecular graphs, ignoring the rich information in subgraphs or motifs. However, it has been widely accepted that substructures play a dominant role in identifying and determining molecular properties. To address such issues, we formulate heterogeneous molecular graphs (HMGs), and introduce a novel architecture to exploit both molecular motifs and 3D geometry. Precisely, we extract functional groups as motifs for small molecules and employ reinforcement learning to adaptively select quaternary amino acids as motif candidates for proteins. Then HMGs are constructed with both atom-level and motif-level nodes. To better accommodate those HMGs, we introduce a variant of Transformer named Molformer, which adopts a heterogeneous self-attention layer to distinguish the interactions between multi-level nodes. Besides, it is also coupled with a multi-scale mechanism to capture fine-grained local patterns with increasing contextual scales. An attentive farthest point sampling algorithm is also proposed to obtain the molecular representations. We validate Molformer across a broad range of domains, including quantum chemistry, physiology, and biophysics. Extensive experiments show that Molformer outperforms or achieves the comparable performance of several state-of-the-art baselines. Our work provides a promising way to utilize informative motifs from the perspective of multi-level graph construction.


title: Influence of Allee Effect on Extreme Events in Coupled Three Species Systems

abstract: We consider the dynamics of two coupled three-species population patches, incorporating the Allee Effect, focussing on the onset of extreme events in the coupled system. First we show that the interplay between coupling and the Allee effect may change the nature of the dynamics, with regular periodic dynamics becoming chaotic in a range of Allee parameters and coupling strengths. Further, the growth in the vegetation population displays an explosive blow-up beyond a critical value of coupling strength and Allee parameter. Most interestingly, we observe that beyond a threshold of coupling strength and Allee parameter, the population densities of all three species exhibit non-zero probability of yielding extreme events. The emergence of extreme events in the predator populations in the patches is the most prevalent, and the probability of obtaining large deviations in the predator populations is not affected significantly by either the coupling strength or the Allee effect. In the absence of the Allee effect the prey population in the coupled system exhibits no extreme events for low coupling strengths, but yields a sharp increase in extreme events after a critical strength of coupling. The vegetation population in the patches display a small finite probability of extreme events for strong enough coupling, only in the presence of Allee effect. Lastly we consider the influence of additive noise on the continued prevalence of extreme events. Very significantly, we find that noise suppresses the unbounded vegetation growth that was induced by a combination of Allee effect and coupling. Further, we demonstrate that noise mitigates extreme events in all three populations, and beyond a noise level we do not observe any extreme events in the system at all. This finding has important bearing on the potential observability of extreme events in natural and laboratory systems.


title: Boundedness of some operators on weighted amalgam spaces

abstract: Let $t\in(0,\infty)$, $p\in(1,\infty)$, $q\in[1,\infty]$, $w\in A_p$ and $v\in A_q$. We introduce the weighted amalgam space $(L^p,L^q)_t(\mathbb R^n)$ and show some properties of it. Some estimates on these spaces for the classical operators in harmonic analysis, such as the Hardy--Littlewood maximal operator, the Calder\'on--Zygmund operator, the Riesz potential, singular integral operators with the rough kernel, the Marcinkiewicz integral, the Bochner-Riesz operator, the Littlewood-Paley $g$ function and the intrinsic square function, are considered. Our main method is extrapolation. We obtain some new weak results for these operators on weighted amalgam spaces.


title: Soft gravitational radiation from multi-body collisions

abstract: We derive a universal expression for the gravitational radiation energy spectrum $dE^{GW}/d\omega$ at sub-leading order emitted from a generic gravitational hard scattering of multi-particles or multi-bodies. Our result includes all $\mathcal{O}(\omega)$ corrections to the gravitational radiation flux from a generic $2\rightarrow N$ collision, in both the cases of massless and massive particles/bodies. We also show the dependence of the radiation energy fluxby the quantum spin in case of particle collisions. Then, we consider the specific case of a gravitational elastic scattering of two massive bodies, i.e. $m+M\rightarrow m+M$ with $m,M$ the masses of the two bodies respectively. We demonstrate that in this case all $\mathcal{O}(\omega)$ contributions to the energy flux exactly cancel each others. Nevertheless, we also show that, for a $2\rightarrow 2$ inelastic scattering, the inclusion of sub-leading soft gravitons leads to a not zero radiation flux, having a simple expression in certain asymptotic regimes. Our results can be applied to the case of Black Holes' collisions with possible testable implications in gravitational waves physics.


title: Virtual Private Mobile Network with Multiple Gateways for B5G Location Privacy

abstract: In a beyond-5G (B5G) scenario, we consider a virtual private mobile network (VPMN), i.e., a set of user equipments (UEs) directly communicating in a device-to-device (D2D) fashion, and connected to the cellular network by multiple gateways. The purpose of the VPMN is to hide the position of the VPMN UEs to the mobile network operator (MNO). We investigate the design and performance of packet routing inside the VPMN. First, we note that the routing that maximizes the rate between the VPMN and the cellular network leads to an unbalanced use of the gateways by each UE. In turn, this reveals information on the location of the VPMN UEs. Therefore, we derive a routing algorithm that maximizes the VPMN rate, while imposing for each UE the same data rate at each gateway, thus hiding the location of the UE. We compare the performance of the resulting solution, assessing the location privacy achieved by the VPMN, and considering both the case of single hop and multihop in the transmissions from the UEs to the gateways.


title: Analyticity of the energy in an Ising spin glass with correlated disorder

abstract: The average energy of the Ising spin glass is known to have no singularity along a special line in the phase diagram although there exists a critical point on the line. This result on the model with uncorrelated disorder is generalized to the case with correlated disorder. For a class of correlations in disorder that suppress frustration, we show that the average energy in a subspace of the phase diagram is expressed as the expectation value of a local gauge variable of the $Z_2$ gauge Higgs model, from which we prove that the average energy has no singularity although the subspace is likely to have a phase transition on it. This is a generalization of the result for uncorrelated disorder. Though it is difficult to obtain an explicit expression of the energy in contrast to the case of uncorrelated disorder, an exact closed-form expression of a physical quantity related to the energy is derived in three dimensions using a duality relation. Identities and inequalities are proved for the specific heat and correlation functions.


title: Mixed-norm Amalgam Spaces

abstract: We introduce the mixed-norm amalgam spaces $(L^{\vec{p}},L^{\vec{s}})(\mathbb{R}^n)$ and $(L^{\vec{p}},L^{\vec{s}})^{\alpha}(\mathbb{R}^n)$, and show their some basic properties. In addition, we find the predual $\mathcal{H}(\vec{p}',\vec{s}\,',\alpha')$ of mixed-norm amalgam spaces $(L^{\vec{p}},\ell^{\vec{s}})^{\alpha}(\mathbb{R}^n)$ by the dual spaces $(L^{\vec{p}'},\ell^{\vec{s}\,'})(\mathbb{R}^n)$ of $(L^{\vec{p}},\ell^{\vec{s}})(\mathbb{R}^n)$, where $(L^{\vec{p}},L^{\vec{s}})(\mathbb{R}^n)=(L^{\vec{p}},\ell^{\vec{s}})(\mathbb{R}^n)$ and $(L^{\vec{p}},L^{\vec{s}})^{\alpha}(\mathbb{R}^n)=(L^{\vec{p}},\ell^{\vec{s}})^{\alpha}(\mathbb{R}^n)$. Then, we study the strong-type estimates for fractional integral operators $I_{\gamma}$ on mixed-norm amalgam spaces $(L^{\vec{p}},L^{\vec{s}})^{\alpha}(\mathbb{R}^n)$. And, the strong-type estimates of linear commutators $[b,I_{\gamma}]$ generated by $b\in BMO(\mathbb{R}^n)$ and $I_{\gamma}$ on mixed-norm amalgam spaces $(L^{\vec{p}},L^{\vec{s}})^{\alpha}(\mathbb{R}^n)$ are established as well. Furthermore, based on the dual theorem, the characterization of $BMO(\mathbb{R}^n)$ by the boundedness of $[b,I_\gamma]$ from $(L^{\vec{p}},L^{\vec{s}})^{\alpha}(\mathbb{R}^n)$ to $(L^{\vec{q}},L^{\vec{s}})^{\beta}(\mathbb{R}^n)$ is given, which is a new result even for the classical amalgam spaces.


title: Moderately Suppressed Dimension-five Proton Decay in a Flipped $SU(5)$ Model

abstract: We study colored Higgsino-mediated proton decay (dimension-five proton decay) in a model based on the flipped $SU(5)$ GUT. In the model, the GUT-breaking ${\bf10}$, ${\bf \overline{10}}$ fields have a GUT-scale mass term and gain VEVs through higher-dimensional operators, which induces an effective mass term between the color triplets in the ${\bf 5}$, ${\bf \bar{5}}$ Higgs fields that is not much smaller than the GUT scale. This model structure gives rise to observable dimension-five proton decay, and at the same time achieves moderate suppression on dimension-five proton decay that softens the tension with the current bound on $\Gamma(p\to K^+\nu)$. We investigate the flavor dependence of the Wilson coefficients of the operators relevant to dimension-five proton decay, by relating them with diagonalized Yukawa couplings and CKM matrix components in MSSM, utilizing the fact that the GUT Yukawa couplings are in one-to-one correspondence with the MSSM Yukawa couplings in flipped models. Then we numerically evaluate the Wilson coefficients, and predict the distributions of the ratios of the partial widths of various proton decay modes.


title: Collision of two self-trapped atomic matter wave packets in an optical ring cavity

abstract: The interaction between atomic Bose-Einstein condensate (BEC) and light field in an optical ring cavity gives rise to many interesting phenomena such as supersolid and movable self-trapped matter wave packets. Here we examined the collision of two self-trapped atomic matter wave packets in an optical ring cavity, and abundant colliding phenomena have been found in the system. Depending on the magnitude of colliding velocity, the collision dynamics exhibit very different features compared with the cavity-free case. When the initial colliding velocities of the two wave packets are small, they correlatedly oscillate around their initial equilibrium positions with a small amplitude. Increasing the collision velocity leads to severe scattering of the BEC atoms; after the collision, the two self-trapped wave packets usually break into small pieces. Interestingly, we found that such a medium velocity collision is of great phase sensitivity, which may make the system useful in precision matter wave interferometry. When the colliding velocity is further increased, in the bad cavity limit, the two wave packets collide phenomenally similar to two classical particles -- they firstly approach each other, then separate with their shape virtually maintained. However, beyond the bad cavity limit, they experience severe spatial spreading.


title: AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networks

abstract: Artefacts that differentiate spoofed from bona-fide utterances can reside in spectral or temporal domains. Their reliable detection usually depends upon computationally demanding ensemble systems where each subsystem is tuned to some specific artefacts. We seek to develop an efficient, single system that can detect a broad range of different spoofing attacks without score-level ensembles. We propose a novel heterogeneous stacking graph attention layer which models artefacts spanning heterogeneous temporal and spectral domains with a heterogeneous attention mechanism and a stack node. With a new max graph operation that involves a competitive mechanism and an extended readout scheme, our approach, named AASIST, outperforms the current state-of-the-art by 20% relative. Even a lightweight variant, AASIST-L, with only 85K parameters, outperforms all competing systems.


title: Subordinated Markov processes: sharp estimates for heat kernels and Green functions

abstract: We prove sharp estimates on heat kernels and Green functions for subordinate Markov processes with both discrete an continuous time, under relatively weak assumptions about original processes as well as Laplace exponents of subordinators. We also show stability of heat kernel estimates in the discrete settings.


title: Leaked-Web: Accurate and Efficient Machine Learning-Based Website Fingerprinting Attack through Hardware Performance Counters

abstract: Users' website browsing history contains sensitive information, like health conditions, political interests, financial situations, etc. Some recent studies have demonstrated the possibility of inferring website fingerprints based on important usage information such as traffic, cache usage, memory usage, CPU activity, power consumption, and hardware performance counters information. However, existing website fingerprinting attacks demand a high sampling rate which causes high performance overheads and large network traffic, and/or they require launching an additional malicious website by the user, which is not guaranteed. As a result, such drawbacks make the existing attacks more noticeable to users and corresponding fingerprinting detection mechanisms. In response, in this work, we propose Leaked-Web, a novel accurate and efficient machine learning-based website fingerprinting attack through processor's Hardware Performance Counters (HPCs). Leaked-Web efficiently collects hardware performance counters in users' computer systems at a significantly low granularity monitoring rate and sends the samples to the remote attack's server for further classification. Leaked-Web examines the web browsers' microarchitectural features using various advanced machine learning algorithms ranging from classical, boosting, deep learning, and time-series models. Our experimental results indicate that Leaked-Web based on a LogitBoost ML classifier using only the top 4 HPC features achieves 91% classification accuracy outperforming the state-of-the-art attacks by nearly 5%. Furthermore, our proposed attack obtains a negligible performance overhead (only <1%), around 12% lower than the existing hardware-assisted website fingerprinting attacks.


title: From Control to Mathematics-Part II: Observability-Based Design for Iterative Methods in Solving Linear Equations

abstract: The control approaches generally resort to the tools from the mathematics, but whether and how the mathematics can benefit from the control approaches is unclear. This paper aims to bring the "control design" idea into the mathematics by providing an observer-based iterative method that focuses on solving linear algebraic equations (LAEs). An inherent relationship is revealed between the problem-solving of LAEs and the design of observer-based control systems, with which the iterative method for solving LAEs is exploited based on the design of the basic state observers. It is shown that all (least squares) solutions for any (un)solvable LAEs can be determined exponentially fast or monotonically with different selections of initial conditions. By integrating the design idea of the deadbeat control, the solving of LAEs can be achieved within only finite iterations. In particular, our proposed iterative method can be leveraged to develop a new observer-based design algorithm to realize the perfect tracking objective of conventional two-dimensional iterative learning control (ILC) systems, where the gap between classical ILC design and popular feedback-based control design is narrowed.


title: Charged-current non-standard neutrino interactions at the LHC and HL-LHC

abstract: A series of new physics scenarios predict the existence of the extra charged gauge boson $W'$, which can induce charged-current (CC) non-standard neutrino interactions (NSIs). The theoretical constraints on the simplified $W'$ model and further on the CC NSI parameters $\widetilde{\epsilon}^{ qq'Y}_{\alpha\beta}$ from partial wave unitarity and $W'$ decays are considered. The sensitivity of the process $p p \rightarrow W'\rightarrow \ell\nu $ to the $W'$ model at the LHC and high-luminosity~(HL) LHC experiments is investigated by estimating the expected constraints on $\widetilde{\epsilon}^{qq'Y}_{\alpha\beta}$ ($\alpha = \beta = e $ or $\mu$) using a Monte-Carlo~(MC) simulation. We find that the interference effect plays an important role, and the LHC can strongly constrain $\widetilde{\epsilon}^{qq'L}_{\alpha\beta}$. Compared with those at the $13 \;{\rm TeV}$ LHC with $\mathcal{L}=139\;{\rm fb}^{-1}$, the expected constraints at the $14 \;{\rm TeV}$ LHC with $\mathcal{L}=3\;{\rm ab}^{-1}$ can be strengthened to approximately one order of magnitude.


title: A Game Theoretic Approach for Demand Response Allocation among Strategic Prosumers in Regulated Distribution Utilities

abstract: This paper studies an optimal allocation of demand response (DR) provisions among strategic photovoltaic (PV) prosumers, through third-party DR providers which operate within the territory of the regulated distribution utility. A game theoretic model, consisting of a sequential game coupled with a simultaneous game, is proposed to capture the competition and interaction among PV prosumers, the third-party DR providers, and the utility company. An iterative approach is proposed to solve for the Nash equilibrium of the game. With this game theoretic model, the DR provision quantities for strategic PV prosumers are optimally determined, considering the profit maximizations of the PV prosumers, the DR providers, and the utility company. Case studies on an IEEE test system verifies the proposed model and the solution approach.


title: Global Weather for the Astronomical Observatories

abstract: Astronomical sites occupying observing instruments have to be selected according to many factors. Among these factors, geographic location of the site and quality of atmosphere above the site play an important role in the decision process. The following factors were chosen to create layers at their geographic locations (observatories: 1905 northern, 235 southern) from the \href{https://www.astrogis.org}{astroGIS database}: CC (cloud coverage), PWV (precipitable water vapor), AOD (atmospheric optical depth), VWV (vertical wind velocity) and HWV (horizontal wind velocity). In order to estimate astronomical importance of geographic location of the sites and quality of airmass above the sites, DEM (digital elevation model) and LAT (latitude of observatory location) layers were also included. Two periodic variations have been produced from these factors: monthly and annual averages. In addition to the variations or trends a complete statistical analysis was carried out for all factors to investigate the potential correlations between the factors: There is a clear difference between northern and southern hemispheres. Exchange of meteorological seasons between hemispheres are also compliant within factors. The geographical locations of most of the observatories found to be "not suitable": On the average, DEM is low (550 m), CC is high (70\%) and PWV is high (14 mm). There seems to be no apparent long-term variations and/or patterns in all factors. We once again confirm the common expectation of astronomy: \textit{as DEM increases astronomical conditions get better} (CC, PWV and AOD gets lower values). All the results will be made available online through astroGIS database.


title: Row-clustering of a Point Process-valued Matrix

abstract: Structured point process data harvested from various platforms poses new challenges to the machine learning community. By imposing a matrix structure to repeatedly observed marked point processes, we propose a novel mixture model of multi-level marked point processes for identifying potential heterogeneity in the observed data. Specifically, we study a matrix whose entries are marked log-Gaussian Cox processes and cluster rows of such a matrix. An efficient semi-parametric Expectation-Solution (ES) algorithm combined with functional principal component analysis (FPCA) of point processes is proposed for model estimation. The effectiveness of the proposed framework is demonstrated through simulation studies and a real data analysis.


title: HyGain: High Performance, Energy-Efficient Hybrid Gain Cell based Cache Hierarchy

abstract: In this paper, we propose a 'full-stack' solution to designing high capacity and low latency on-chip cache hierarchies by starting at the circuit level of the hardware design stack. First, we propose a novel Gain Cell (GC) design using FDSOI. The GC has several desirable characteristics, including ~50% higher storage density and ~50% lower dynamic energy as compared to the traditional 6T SRAM, even after accounting for peripheral circuit overheads. We also exploit back-gate bias to increase retention time to 1.12 ms (~60x of eDRAM) which, combined with optimizations like staggered refresh, makes it an ideal candidate to architect all levels of on-chip caches. We show that compared to 6T SRAM, for a given area budget, GC based caches, on average, provide 29% and 36% increase in IPC for single- and multi-programmed workloads, respectively on contemporary workloads including SPEC CPU2017. We also observe dynamic energy savings of 42% and 34% for single- and multi-programmed workloads, respectively. We utilize the inherent properties of the proposed GC, including decoupled read and write bitlines to devise optimizations to save precharge energy and architect GC caches with better energy and performance characteristics. Finally, in a quest to utilize the best of all worlds, we combine GC with STT-RAM to create hybrid hierarchies. We show that a hybrid hierarchy with GC caches at L1 and L2, and an LLC split between GC and STT-RAM, with asymmetric write optimization enabled, is able to provide a 54% benefit in energy-delay product (EDP) as compared to an all-SRAM design, and 13% as compared to an all-GC cache hierarchy, averaged across multi-programmed workloads.


title: Learning Structural Representations for Recipe Generation and Food Retrieval

abstract: Food is significant to human daily life. In this paper, we are interested in learning structural representations for lengthy recipes, that can benefit the recipe generation and food cross-modal retrieval tasks. Different from the common vision-language data, here the food images contain mixed ingredients and target recipes are lengthy paragraphs, where we do not have annotations on structure information. To address the above limitations, we propose a novel method to unsupervisedly learn the sentence-level tree structures for the cooking recipes. Our approach brings together several novel ideas in a systematic framework: (1) exploiting an unsupervised learning approach to obtain the sentence-level tree structure labels before training; (2) generating trees of target recipes from images with the supervision of tree structure labels learned from (1); and (3) integrating the learned tree structures into the recipe generation and food cross-modal retrieval procedure. Our proposed model can produce good-quality sentence-level tree structures and coherent recipes. We achieve the state-of-the-art recipe generation and food cross-modal retrieval performance on the benchmark Recipe1M dataset.


title: Audio Captioning Using Sound Event Detection

abstract: This technical report proposes an audio captioning system for DCASE 2021 Task 6 audio captioning challenge. Our proposed model is based on an encoder-decoder architecture with bi-directional Gated Recurrent Units (BiGRU) using pretrained audio features and sound event detection. A pretrained neural network (PANN) is used to extract audio features and Word2Vec is selected with the aim of extracting word embeddings from the audio captions. To create semantically meaningful captions, we extract sound events from the audio clips and feed the encoder-decoder architecture with sound events in addition to PANNs features. Our experiments on the Clotho dataset show that our proposed method significantly achieves better results than the challenge baseline model across all evaluation metrics.


title: Evaluation on Energy Efficiency of UE in UL Cell-Free Massive MIMO System With Power Control Methods

abstract: Cell-free massive multiple-input multiple-output (CF mMIMO) systems are expected to provide faster and more robust connections to user equipments (UEs) by cooperation of a massive number of distributed access points, and to be one of the key technologies for beyond 5G (B5G). In B5G, energy efficiency (EE) is one of the most important key indicators because various kinds of devices connect to the network and communicate with each other. While previously proposed transmit power control methods in CF mMIMO systems have aimed to maximize spectral efficiency or total EE, we evaluate in this paper a different approach for maximizing the minimum EE among all UEs. We show that this algorithm can provide the optimum solution in polynomial time, and demonstrate with simulations the improved minimum EE compared to conventional methods.


title: Inducing Equilibria via Incentives: Simultaneous Design-and-Play Ensures Global Convergence

abstract: To regulate a social system comprised of self-interested agents, economic incentives are often required to induce a desirable outcome. This incentive design problem naturally possesses a bilevel structure, in which a designer modifies the rewards of the agents with incentives while anticipating the response of the agents, who play a non-cooperative game that converges to an equilibrium. The existing bilevel optimization algorithms raise a dilemma when applied to this problem: anticipating how incentives affect the agents at equilibrium requires solving the equilibrium problem repeatedly, which is computationally inefficient; bypassing the time-consuming step of equilibrium-finding can reduce the computational cost, but may lead the designer to a sub-optimal solution. To address such a dilemma, we propose a method that tackles the designer's and agents' problems simultaneously in a single loop. Specifically, at each iteration, both the designer and the agents only move one step. Nevertheless, we allow the designer to gradually learn the overall influence of the incentives on the agents, which guarantees optimality after convergence. The convergence rate of the proposed scheme is also established for a broad class of games.


title: Clique percolation method: memory efficient almost exact communities

abstract: Automatic detection of relevant groups of nodes in large real-world graphs, i.e. community detection, has applications in many fields and has received a lot of attention in the last twenty years. The most popular method designed to find overlapping communities (where a node can belong to several communities) is perhaps the clique percolation method (CPM). This method formalizes the notion of community as a maximal union of $k$-cliques that can be reached from each other through a series of adjacent $k$-cliques, where two cliques are adjacent if and only if they overlap on $k-1$ nodes. Despite much effort CPM has not been scalable to large graphs for medium values of $k$. Recent work has shown that it is possible to efficiently list all $k$-cliques in very large real-world graphs for medium values of $k$. We build on top of this work and scale up CPM. In cases where this first algorithm faces memory limitations, we propose another algorithm, CPMZ, that provides a solution close to the exact one, using more time but less memory.


title: Weak gravitational lensing shear measurement with FPFS: analytical mitigation of noise bias and selection bias

abstract: Dedicated 'Stage IV' observatories will soon observe the entire extragalactic sky, to measure the 'cosmic shear' distortion of galaxy shapes by weak gravitational lensing. To measure the apparent shapes of those galaxies, we present an improved version of the Fourier Power Function Shapelets (FPFS) shear measurement method. This now includes analytic corrections for sources of bias that plague all shape measurement algorithms: including noise bias (due to noise in nonlinear combinations of observable quantities) and selection bias (due to sheared galaxies being more or less likely to be detected). Crucially, these analytic solutions do not rely on calibration from external image simulations. For isolated galaxies, the small residual $\sim$$10^{-3}$ multiplicative bias and $\lesssim$$10^{-4}$ additive bias now meet science requirements for Stage IV experiments. FPFS also works accurately for faint galaxies and robustly against stellar contamination. Future work will focus on deblending overlapping galaxies. The code used for this paper can process $>$$1000$ galaxy images per CPU second and is available from https://github.com/mr-superonion/FPFS.


title: Intermediate planar algebra revisited, II

abstract: We describe the subfactor planar algebra of an intermediate subfactor $N\subset Q \subset M$ of an extremal subfactor $N\subset M$ of finite Jones index which is not necessarily irreducible.


title: Passivity-Based Decentralized Criteria for Small-Signal Stability of Power Systems with Converter-Interfaced Generation

abstract: With the increasing penetration of converter-interfaced distributed generation systems, it would be advantageous to specify local compliance criteria for these devices to ensure the small-signal stability of the interconnected system. Passivity of the device admittance, which is an example of a local criterion, has been used previously to avoid resonances between these devices and the lightly damped oscillatory modes of the network. Typical active and reactive power control strategies like droop control and virtual synchronous generator control inherently violate the passivity constraints on admittance at low frequencies, although this does not necessarily mean that the interconnected system will be unstable. Therefore, passivity of the admittance is unsuitable as a stability criterion for devices that are represented by their wide-band models. To overcome this problem, this paper proposes the use of criteria based on admittance at higher frequencies and an alternative transfer function at lower frequencies. The alternative representation uses active and reactive power and the derivatives of the polar components of voltage as interface variables. To allow for the separate analysis at low and high frequencies, the device dynamics should exhibit a slow-fast separation; this is proposed as an additional constraint. Adherence to the proposed criteria is not onerous and is easily verifiable through frequency response analysis.


title: Perturbative QCD analysis of neutral $B$-meson decays into $\sigma\sigma, \sigma f_0$ and $f_0 f_0$

abstract: The decays of $B_{d,s}^0 \to \sigma\sigma, \sigma f_0, f_0 f_0$, with $\sigma$ and $f_0$ denoting the light scalar mesons $f_0(500)$ and $f_0(980)$ in the two-quark picture, are studied in the perturbative QCD approach based on $k_T$ factorization. With the referenced value of the mixing angle $|\varphi| \sim 25^\circ$ for the $\sigma-f_0$ mixing in the quark-flavor basis, it is of great interest to obtain that: (a) these neutral $B$-meson decays into $\sigma\sigma, \sigma f_0$, and $f_0 f_0$ have large branching ratios in the order of $10^{-6} \sim 10^{-4}$, which mean the possibly constructive interferences existed in the decays with different flavor states, and then are expected to be tested at the Large Hadron Collider beauty and/or Belle-II experiments in the (near) future; (b) the large direct CP violations could be easily found in the $B_d^0 \to \sigma\sigma, f_0 f_0$ and $B_{d,s}^0 \to \sigma f_0$ decays, which indicate the considerable interferences between the tree and the penguin decay amplitudes involved in these four modes, and would be confronted with the future measurements; (c) these neutral $B$-meson decays could be examined through the secondary decay chain $\sigma/f_0 \to \pi^+ \pi^-$, namely, the four-body decays of $B_{d,s}^0 \to (\pi^+ \pi^-)_{\sigma(f_0)} (\pi^+ \pi^-)_{\sigma(f_0)}$. On the other side, it seems that other 4 four-body decays of $B_d^0 \to (\pi^+ \pi^-)_{\sigma} (K^+ K^-)_{f_0}$, $B_s^0 \to (\pi^+ \pi^-)_{\sigma(f_0)} (K^+ K^-)_{f_0}$, and $B_s^0 \to (K^+ K^-)_{f_0} (K^+ K^-)_{f_0}$ could also be detected at the relevant experiments, if the $f_0 \to K^+ K^-$ could be identified from the $\phi \to K^+ K^-$ clearly.


title: Max and Coincidence Neurons in Neural Networks

abstract: Network design has been a central topic in machine learning. Large amounts of effort have been devoted towards creating efficient architectures through manual exploration as well as automated neural architecture search. However, todays architectures have yet to consider the diversity of neurons and the existence of neurons with specific processing functions. In this work, we optimize networks containing models of the max and coincidence neurons using neural architecture search, and analyze the structure, operations, and neurons of optimized networks to develop a signal-processing ResNet. The developed network achieves an average of 2% improvement in accuracy and a 25% improvement in network size across a variety of datasets, demonstrating the importance of neuronal functions in creating compact, efficient networks.


title: Hit and Lead Discovery with Explorative RL and Fragment-based Molecule Generation

abstract: Recently, utilizing reinforcement learning (RL) to generate molecules with desired properties has been highlighted as a promising strategy for drug design. A molecular docking program - a physical simulation that estimates protein-small molecule binding affinity - can be an ideal reward scoring function for RL, as it is a straightforward proxy of the therapeutic potential. Still, two imminent challenges exist for this task. First, the models often fail to generate chemically realistic and pharmacochemically acceptable molecules. Second, the docking score optimization is a difficult exploration problem that involves many local optima and less smooth surfaces with respect to molecular structure. To tackle these challenges, we propose a novel RL framework that generates pharmacochemically acceptable molecules with large docking scores. Our method - Fragment-based generative RL with Explorative Experience replay for Drug design (FREED) - constrains the generated molecules to a realistic and qualified chemical space and effectively explores the space to find drugs by coupling our fragment-based generation method and a novel error-prioritized experience replay (PER). We also show that our model performs well on both de novo and scaffold-based schemes. Our model produces molecules of higher quality compared to existing methods while achieving state-of-the-art performance on two of three targets in terms of the docking scores of the generated molecules. We further show with ablation studies that our method, predictive error-PER (FREED(PE)), significantly improves the model performance.


title: A New Sequential Optimality Condition of Cardinality-Constrained Optimization Problems and Application

abstract: In this paper, we consider the cardinality-constrained optimization problems and propose a new sequential optimality condition for the continuous relaxation reformulation which is popular recently. It is stronger than the existing results and is still a first-order necessity condition for the cardinality constraint problems without any additional assumptions. Meanwhile, we provide a problem-tailored weaker constraint qualification, which can guarantee that new sequential conditions are Mordukhovich-type stationary points. On the other hand, we improve the theoretical results of the augmented Lagrangian algorithm. Under the same condition as the existing results, we prove that any feasible accumulation point of the iterative sequence generated by the algorithm satisfies the new sequence optimality condition. Furthermore, the algorithm can converge to the Mordukhovich-type (essentially strong) stationary point if the problem-tailored constraint qualification is satisfied.


title: DenDrift: A Drift-Aware Algorithm for Host Profiling

abstract: Detecting and reacting to unauthorized actions is an essential task in security monitoring. What make this task challenging are the large number and various categories of hosts and processes to monitor. To these we should add the lack of an exact definition of normal behavior for each category. Host profiling using stream clustering algorithms is an effective means of analyzing hosts' behaviors, categorizing them, and identifying atypical ones. However, unforeseen changes in behavioral data (i.e. concept drift) make the obtained profiles unreliable. DenStream is a well-known stream clustering algorithm, which can be effectively used for host profiling. This algorithm is an incremental extension of DBSCAN which is a non-parametric algorithm widely used in real-world clustering applications. Recent experimental studies indicate that DenStream is not robust against concept drift. In this paper, we present DenDrift as a drift-aware host profiling algorithm based on DenStream. DenDrift relies on non-negative matrix factorization for dimensionality reduction and Page-Hinckley test for drift detection. We have done experiments on both synthetic and industrial datasets and the results affirm the robustness of DenDrift against abrupt, gradual and incremental drifts.


title: Constant scalar curvature Kaehler metrics on ramified Galois coverings

abstract: We give sufficient conditions for the existence of Kaehler-Einstein and constant scalar curvature Kaehler (cscK) metrics on finite ramified Galois coverings of a cscK manifold in terms of cohomological conditions on the Kaehler classes and the branching divisor. This result generalizes previous work on Kaehler-Einstein metrics by Li-Sun [Comm. Math. Phys. 2014], and extends Chen-Cheng's existence results for cscK metrics in [J. Amer. Math. Soc. 2021].


title: Dispersion estimates for the boundary integral operator associated with the fourth order Schr\"odinger equation posed on the half line

abstract: In this paper, we prove dispersion estimates for the boundary integral operator associated with the fourth order Schr\"odinger equation posed on the half line. Proofs of such estimates for domains with boundaries are rare and generally require highly technical approaches, as opposed to our simple treatment which is based on constructing a boundary integral operator of oscillatory nature via the Fokas method. Our method is uniform and can be extended to other higher order partial differential equations where the main equation possibly involves more than one spatial derivatives.


title: Evidences for the existence of the ultimate regime in supergravitational turbulent thermal convection

abstract: What is the final state of turbulence when the driving parameter approaches to infinity? For thermal turbulence, in 1962, Kraichnan proposed a so-called ultimate scaling dependence of the heat transport (quantified by the Nusselt number $\text{Nu}$) on the Rayleigh number ($\text{Ra}$), which can be extrapolated to arbitrarily high $\text{Ra}$. The existence of Kraichnan ultimate scaling has been intensively debated in the past decades. In this work, using a supergravitational thermal convection system, with an effective gravity up to 100 times the Earth's gravity, both Rayleigh number and shear Reynolds number can be boosted due to the increase of the buoyancy driving and the additional Coriolis forces. Over a decade of $\text{Ra}$ range, we demonstrate the existence of Kraichnan-like ultimate regime with four direct evidences: the ultimate scaling dependence of $\text{Nu}$ versus $\text{Ra}$; the appearance of turbulent velocity boundary layer profile; the enhanced strength of the shear Reynolds number; the new statistical properties of local temperature fluctuations. The present findings will greatly improve the understanding of the flow dynamics in geophysical and astrophysical flows.


title: Inferring the Localization of White-Matter Tracts using Diffusion Driven Label Fusion

abstract: Inferring which pathways are affected by a brain lesion is key for both pre and post-treatment planning. However, many disruptive lesions cause changes in the tissue that interrupt tractography algorithms. In such cases, aggregating information from healthy subjects can provide a solution to inferring the affected pathways. In this paper, we introduce a novel label fusion technique that leverages diffusion information to locate brain pathways. Through simulations and experiments in publicly available data we show that our method is able to correctly reconstruct brain pathways, even if they are affected by a focal lesion.


title: Dynamic instability of individual carbon nanotube growth revealed by in situ homodyne polarization microscopy

abstract: Understanding the kinetic selectivity of carbon nanotube growth at the scale of individual nanotubes is essential for the development of high chiral selectivity growth methods. Here we demonstrate that homodyne polarization microscopy can be used for high-throughput imaging of long individual carbon nanotubes under real growth conditions (at ambient pressure, on a substrate), and with sub-second time resolution. Our in situ observations on hundreds of individual nanotubes reveal that about half of them grow at a constant rate all along their lifetime while the other half exhibits stochastic changes in growth rates, and switches between growth, pause and shrinkage. Statistical analysis shows that the growth rate of a given nanotube essentially varies between two values, with similar average ratio (~1.7) regardless of whether the rate change is accompanied by a change in chirality. These switches indicate that the nanotube edge or the catalyst nanoparticle fluctuates between different configurations during growth.


title: Benchmarking Data Lakes Featuring Structured and Unstructured Data with DLBench

abstract: In the last few years, the concept of data lake has become trendy for data storage and analysis. Thus, several design alternatives have been proposed to build data lake systems. However, these proposals are difficult to evaluate as there are no commonly shared criteria for comparing data lake systems. Thus, we introduce DLBench, a benchmark to evaluate and compare data lake implementations that support textual and/or tabular contents. More concretely, we propose a data model made of both textual and raw tabular documents, a workload model composed of a set of various tasks, as well as a set of performance-based metrics, all relevant to the context of data lakes. As a proof of concept, we use DLBench to evaluate an open source data lake system we previously developed.


title: Internal Data Imputation in Data Warehouse Dimensions

abstract: Missing values occur commonly in the multidimensional data warehouses. They may generate problems of usefulness of data since the analysis performed on a multidimensional data warehouse is through different dimensions with hierarchies where we can roll up or drill down to the different parameters of analysis. Therefore, it's essential to complete these missing values in order to carry out a better analysis. There are existing data imputation methods which are suitable for numeric data, so they can be applied for fact tables but not for dimension tables. Some other data imputation methods need extra time and effort costs. As consequence, we propose in this article an internal data imputation method for multidimensional data warehouse based on the existing data and considering the intra-dimension and inter-dimension relationships.


title: 3LegRace: Privacy-Preserving DNN Training over TEEs and GPUs

abstract: Leveraging parallel hardware (e.g. GPUs) for deep neural network (DNN) training brings high computing performance. However, it raises data privacy concerns as GPUs lack a trusted environment to protect the data. Trusted execution environments (TEEs) have emerged as a promising solution to achieve privacy-preserving learning. Unfortunately, TEEs' limited computing power renders them not comparable to GPUs in performance. To improve the trade-off among privacy, computing performance, and model accuracy, we propose an \emph{asymmetric} model decomposition framework, \AsymML{}, to (1) accelerate training using parallel hardware; and (2) achieve a strong privacy guarantee using TEEs and differential privacy (DP) with much less accuracy compromised compared to DP-only methods. By exploiting the low-rank characteristics in training data and intermediate features, \AsymML{} asymmetrically decomposes inputs and intermediate activations into low-rank and residual parts. With the decomposed data, the target DNN model is accordingly split into a \emph{trusted} and an \emph{untrusted} part. The trusted part performs computations on low-rank data, with low compute and memory costs. The untrusted part is fed with residuals perturbed by very small noise. Privacy, computing performance, and model accuracy are well managed by respectively delegating the trusted and the untrusted part to TEEs and GPUs. We provide a formal DP guarantee that demonstrates that, for the same privacy guarantee, combining asymmetric data decomposition and DP requires much smaller noise compared to solely using DP without decomposition. This improves the privacy-utility trade-off significantly compared to using only DP methods without decomposition. Furthermore, we present a rank bound analysis showing that the low-rank structure is preserved after each layer across the entire model.


title: Efficient Identification of Butterfly Sparse Matrix Factorizations

abstract: Fast transforms correspond to factorizations of the form $\mathbf{Z} = \mathbf{X}^{(1)} \ldots \mathbf{X}^{(J)}$, where each factor $ \mathbf{X}^{(\ell)}$ is sparse and possibly structured. This paper investigates essential uniqueness of such factorizations, i.e., uniqueness up to unavoidable scaling ambiguities. Our main contribution is to prove that any $N \times N$ matrix having the so-called butterfly structure admits an essentially unique factorization into $J$ butterfly factors (where $N = 2^{J}$), and that the factors can be recovered by a hierarchical factorization method, which consists in recursively factorizing the considered matrix into two factors. This hierarchical identifiability property relies on a simple identifiability condition in the two-layer and fixed-support setting. This approach contrasts with existing ones that fit the product of butterfly factors to a given matrix via gradient descent. The proposed method can be applied in particular to retrieve the factorization of the Hadamard or the discrete Fourier transform matrices of size $N=2^J$. Computing such factorizations costs $\mathcal{O}(N^{2})$, which is of the order of dense matrix-vector multiplication, while the obtained factorizations enable fast $\mathcal{O}(N \log N)$ matrix-vector multiplications and have the potential to be applied to compress deep neural networks.


title: An impossible utopia in distance geometry

abstract: The Distance Geometry Problem asks for a realization of a given weighted graph in $\mathbb{R}^K$. Two variants of this problem, both originating from protein conformation, are based on a given vertex order (which abstracts the protein backbone). Both variants involve an element of discrete decision in the realization of the next vertex in the order using $K$ preceding (already realized) vertices. The difference between these variants is that one requires the $K$ preceding vertices to be contiguous. The presence of this constraint allows one to prove, via a combinatorial counting of the number of solutions, that the realization algorithm is fixed-parameter tractable. Its absence, on the other hand, makes it possible to efficiently construct the vertex order directly from the graph. Deriving a combinatorial counting method without using the contiguity requirement would therefore be desirable. In this paper we prove that, unfortunately, such a counting method cannot be devised in general.


title: Benchmarking Safety Monitors for Image Classifiers with Machine Learning

abstract: High-accurate machine learning (ML) image classifiers cannot guarantee that they will not fail at operation. Thus, their deployment in safety-critical applications such as autonomous vehicles is still an open issue. The use of fault tolerance mechanisms such as safety monitors is a promising direction to keep the system in a safe state despite errors of the ML classifier. As the prediction from the ML is the core information directly impacting safety, many works are focusing on monitoring the ML model itself. Checking the efficiency of such monitors in the context of safety-critical applications is thus a significant challenge. Therefore, this paper aims at establishing a baseline framework for benchmarking monitors for ML image classifiers. Furthermore, we propose a framework covering the entire pipeline, from data generation to evaluation. Our approach measures monitor performance with a broader set of metrics than usually proposed in the literature. Moreover, we benchmark three different monitor approaches in 79 benchmark datasets containing five categories of out-of-distribution data for image classifiers: class novelty, noise, anomalies, distributional shifts, and adversarial attacks. Our results indicate that these monitors are no more accurate than a random monitor. We also release the code of all experiments for reproducibility.


title: Poisson-Orlicz norm and infinite Ergodic Theory

abstract: Urbanik's theorem for a Poisson process on an infinite measure space (X, A, $\mu$) relates integrability of stochastic integrals to a particular Orlicz function space L$\Phi$ ($\mu$) on which the L1-norm of the Poisson process induces a norm (called Poisson-Orlicz in the sequel) that is shown to be equivalent to the classical gauge and Orlicz norms.We obtain a full characterization of stochastic integrals using difference operators that, together with a simple duality argument, allows to derive Urbanik's theorem as well as an optimal inequality between the Orlicz and the Poisson-Orlicz norm.In a second part, we show that the Poisson-Orlicz norm plays a role in infinite Ergodic Theory where it is seen as an alternative to the L1-norm to identify several dynamical invariants that the latter fails to identify. We also show that, whereas the L1-norm fully characterizes exact endomorphisms (Lin's theorem), Poisson-Orlicz norm fully characterizes remotely infinite endomorphisms.


title: Bounded weak solutions to the thin film Muskat problem via an infinite family of Liapunov functionals

abstract: A countably infinite family of Liapunov functionals is constructed for the thin film Muskat problem, which is a second-order degenerate parabolic system featuring cross-diffusion. More precisely, for each n $\ge$ 2 we construct an homogeneous polynomial of degree n, which is convex on [0, $\infty$)^2 , with the property that its integral is a Liapunov functional for the problem. Existence of global bounded non-negative weak solutions is then shown in one space dimension.


title: Identifiability in Two-Layer Sparse Matrix Factorization

abstract: Sparse matrix factorization is the problem of approximating a matrix $\mathbf{Z}$ by a product of $J$ sparse factors $\mathbf{X}^{(J)} \mathbf{X}^{(J-1)} \ldots \mathbf{X}^{(1)}$. This paper focuses on identifiability issues that appear in this problem, in view of better understanding under which sparsity constraints the problem is well-posed. We give conditions under which the problem of factorizing a matrix into \emph{two} sparse factors admits a unique solution, up to unavoidable permutation and scaling equivalences. Our general framework considers an arbitrary family of prescribed sparsity patterns, allowing us to capture more structured notions of sparsity than simply the count of nonzero entries. These conditions are shown to be related to essential uniqueness of exact matrix decomposition into a sum of rank-one matrices, with structured sparsity constraints. In particular, in the case of fixed-support sparse matrix factorization, we give a general sufficient condition for identifiability based on rank-one matrix completability, and we derive from it a completion algorithm that can verify if this sufficient condition is satisfied, and recover the entries in the two sparse factors if this is the case. A companion paper further exploits these conditions to derive identifiability properties and theoretically sound factorization methods for multi-layer sparse matrix factorization with support constraints associated to some well-known fast transforms such as the Hadamard or the Discrete Fourier Transforms.


title: Gauge origin of double dark parity and implication for dark matter

abstract: Dark matter must be stabilized over the cosmological timescale, which demands the existence of a stabilizing symmetry, derived by a dark charge, $D$. The existence of this dark charge may affect the quantization of electric charge, which theoretically shifts the electric charge, thus the hypercharge to a novel gauge extension, $SU(3)_C\otimes SU(2)_L\otimes U(1)_Y\otimes U(1)_N$, where $N$ determines $D=T_3+N$, similar to $Q=T_3+Y$. New observation of this work is that the dark charge is broken down to two kinds of dark parity, $Z_2$ and $Z'_2$, which subsequently imply three scenarios of dark matter. The relic density and direct detection for the scenario of two-component dark matter are investigated in detail.


title: Minimal theory of massive gravity and constraints on the graviton mass

abstract: The Minimal theory of Massive Gravity (MTMG) is endowed non-linearly with only two tensor modes in the gravity sector which acquire a non-zero mass. On a homogeneous and isotropic background the theory is known to possess two branches: the self-accelerating branch with a phenomenology in cosmology which, except for the mass of the tensor modes, exactly matches the one of $\Lambda$CDM; and the normal branch which instead shows deviation from General Relativity in terms of both background and linear perturbations dynamics. For the latter branch we study using several early and late times data sets the constraints on today's value of the graviton mass $\mu_{0}$, finding that $(\mu_{0}/H_{0})^{2}=0.119_{-0.098}^{+0.12}$ at $68\%$ CL, which in turn gives an upper bound at $95\%$ CL as $\mu_{0}<8.4\times10^{-34}$ eV. This corresponds to the strongest bound on the mass of the graviton for the normal branch of MTMG.


title: Overdamped limit at stationarity for non-equilibrium Langevin diffusions

abstract: In this note, we establish that the stationary distribution of a possibly non-equilibrium Langevin diffusion converges, as the damping parameter goes to infinity (or equivalently in the Smoluchowski-Kramers vanishing mass limit), toward a tensor product of the stationary distribution of the corresponding overdamped process and of a Gaussian distribution.


title: Local quantum uncertainty of two gravitational cat states in inhomogeneous magnetic field

abstract: This paper investigates the local quantum correlations (LQU), including entanglement, of two gravitational cat states subjected to an inhomogeneous magnetic field. We derived the LQU expression from the physical quantities associated with the selected system. Our findings suggest that temperature, magnetic field, and magnetic field inhomogeneity may all play a role in determining the degree of intricacy between the gravcats to some extent. Furthermore, these conclusions suggest that the thermal LQU captures a stronger quantum correlation than the entanglement. Especially true for low external magnetic field levels combined with low field inhomogeneity or high-temperature domains. Besides, we obtained the states' separability for large values of field inhomogeneity. Moreover, the correlation of the states obtained is maximal for small magnetic field values at low temperatures. Finally, we note that the state's systems become non-entangled and separable when the gap between the fundamental level and the first excited level becomes large.


title: A free lunch from ViT:Adaptive Attention Multi-scale Fusion Transformer for Fine-grained Visual Recognition

abstract: Learning subtle representation about object parts plays a vital role in fine-grained visual recognition (FGVR) field. The vision transformer (ViT) achieves promising results on computer vision due to its attention mechanism. Nonetheless, with the fixed size of patches in ViT, the class token in deep layer focuses on the global receptive field and cannot generate multi-granularity features for FGVR. To capture region attention without box annotations and compensate for ViT shortcomings in FGVR, we propose a novel method named Adaptive attention multi-scale Fusion Transformer (AFTrans). The Selective Attention Collection Module (SACM) in our approach leverages attention weights in ViT and filters them adaptively to correspond with the relative importance of input patches. The multiple scales (global and local) pipeline is supervised by our weights sharing encoder and can be easily trained end-to-end. Comprehensive experiments demonstrate that AFTrans can achieve SOTA performance on three published fine-grained benchmarks: CUB-200-2011, Stanford Dogs and iNat2017.