title: BEPHAP: A Blockchain-Based Efficient Privacy-Preserving Handover Authentication Protocol with Key Agreement for Internet of Vehicles

abstract: The Internet of Vehicles (IoV) can significantly improve transportation efficiency and ensure traffic safety. Authentication is regarded as the fundamental defense line against attacks in IoV. However, the state-of-the-art approaches suffer from several drawbacks, including bottlenecks of the single cloud server model, high computational overhead of operations, excessive trust in cloud servers and roadside units (RSUs), and leakage of vehicle trajectory privacy. In this paper, BEPHAP, a Blockchain-based Efficient Privacy-preserving Handover Authentication Protocol with key agreement for internet of vehicles, is introduced to address these problems. BEPHAP achieves anonymous cross-domain mutual handover authentication with key agreement based on the tamper-proof blockchain, symmetric cryptography, and the chameleon hash function under a security model that cloud servers and RSUs may launch attacks. BEPHAP is particularly well suited for IoV since it allows vehicles only need to perform lightweight cryptographic operations during the authentication phase. BEPHAP also achieves data confidentiality, unlinkability, traceability, non-repudiation, non-frameability, and key escrow freeness. Formal verification based on ProVerif and formal security proofs based on the BAN logic indicates that BEPHAP is resistant to various typical attacks, such as man-in-the-middle attacks, impersonation attacks, and replay attacks. Performance analysis demonstrates that BEPHAP surpasses existing works in both computation and communication efficiencies. And the message loss rate remains 0 at 5000 requests per second, which meets the requirement of IoV.


title: Homological and cohomological properties of Banach algebras and their second duals

abstract: In this paper, we investigate homological properties of Banach algebras. We show that retractions Banach algebras preserve biprojectivity, contractibility and biflatness. We also prove that contractibility of second dual of a Banach algebra implies contractibility of the Banach algebra. For a Banach algebra $A$ with $\Delta(A)\neq\emptyset$, let $\frak{F}(X, A)$ be one of the Banach algebras $C_b(X, A)$, $C_0(X, A)$, $\hbox{Lip}_\alpha(X, A)$ or $\hbox{lip}_\alpha(X, A)$. In the following, we study homological properties of Banach algebra $\frak{F}(X, A)$, especially contractibility of it. We prove that contractibility of $\frak{F}(X, A)$ is equivalent to finiteness of $X$ and contractibility of $A$. In the case where, $A$ is commutative, we show that $\frak{F}(X, A)$ is contractible if and only if $A$ is a $C^*-$algebra and both $X$ and $\Delta(A)$ are finite. In particular, $\hbox{lip}_\alpha^0(X, A)$ is contractible if and only if $X$ is finite. We also investigate contractibility of $L^1(G, A)$ and establish $L^1(G, A)$ is contractible if and only if $G$ finite and $A$ is contractible. Finally, we show that biprojectivity of the Beurling algebra $L^1(G, \omega)$ is equivalent to compactness of $G$, however, biprojectivity of the Banach algebras $L^1(G, \omega)^{**}$ is equivalent to finiteness of $G$. This result holds for the Banach algebra $M(G, \omega)^{**}$ instead of $L^1(G, \omega)^{**}$.


title: Low energy models of string theory

abstract: String theory is the prime candidate for the theory of everything. However, it must be defined in ten dimensions to be consistent. To get 4D physics, the 6 other dimensions should be curled up in a small compact manifold, this procedure is called string compactification. In this review, we will review different compactification schemes proving that in absence of flux, the compact manifold must be a Calabi-Yau manifold. Then, we review compactifications with flux using generalized complex geometry. We then discuss some applications in cosmology like the swampland project and the cosmological models derived from it. We then discuss non relativistic string theories and introduce a toroidal compactifications for such theories. Finally, we discuss some open questions in the field.


title: Self-Supervised Predictive Coding with Multimodal Fusion for Patient Deterioration Prediction in Fine-grained Time Resolution

abstract: Accurate time prediction of patients' critical events is crucial in urgent scenarios where timely decision-making is important. Though many studies have proposed automatic prediction methods using Electronic Health Records (EHR), their coarse-grained time resolutions limit their practical usage in urgent environments such as the emergency department (ED) and intensive care unit (ICU). Therefore, in this study, we propose an hourly prediction method based on self-supervised predictive coding and multi-modal fusion for two critical tasks: mortality and vasopressor need prediction. Through extensive experiments, we prove significant performance gains from both multi-modal fusion and self-supervised predictive regularization, most notably in far-future prediction, which becomes especially important in practice. Our uni-modal/bi-modal/bi-modal self-supervision scored 0.846/0.877/0.897 (0.824/0.855/0.886) and 0.817/0.820/0.858 (0.807/0.81/0.855) with mortality (far-future mortality) and with vasopressor need (far-future vasopressor need) prediction data in AUROC, respectively.


title: Polarization in the three-state $q$-voter model with anticonformity and bounded confidence

abstract: Engaging with dissenting views, fostering productive disagreements or strategic anticonformity can benefit organizations as it challenges the status quo. The question arises, however, whether such strategic anticonformity ultimately leads to social polarization, which is not a desirable phenomenon. We address this question within an agent-based model of discrete choices. Using the way of modeling social responses in continuous opinion models, we propose a three-state $q$-voter model with anticonformity and bounded confidence. We analyze the model on a complete graph using the mean-field approach and Monte Carlo simulations. We show that strong polarization appears only for a small probability of anticonformity, which means that conformity combined with homophily enhances polarization. Our findings agree with results obtained previously in the group discussion experiment and within various continuous opinion models.


title: Stability and large-time behavior on 3D incompressible MHD equations with partial dissipation near a background magnetic field

abstract: Physical experiments and numerical simulations have observed a remarkable stabilizing phenomenon: a background magnetic field stabilizes and damps electrically conducting fluids. This paper intends to establish this phenomenon as a mathematically rigorous fact on a magnetohydrodynamic (MHD) system with anisotropic dissipation in $\mathbb R^3$. The velocity equation in this system is the 3D Navier-Stokes equation with dissipation only in the $x_1$-direction while the magnetic field obeys the induction equation with magnetic diffusion in two horizontal directions. We establish that any perturbation near the background magnetic field $(0,1,0)$ is globally stable in the Sobolev setting $H^3(\mathbb R^3)$. In addition, explicit decay rates in $H^2(\mathbb R^3)$ are also obtained. When there is no presence of the magnetic field, the 3D anisotropic Navier-Stokes equation in $\mathbb R^3$ is not well understood and the small data global well-posedness remains an intriguing open problem. This paper reveals the mechanism of how the magnetic field generates enhanced dissipation and helps stabilize the fluid.


title: Fiberwise Bergman kernels, vector bundles, and log-subharmonicity

abstract: In this article, we consider Bergman kernels related to modules at boundary points for singular hermitian metrics on holomorphic vector bundles, and obtain a log-subharmonicity property of the Bergman kernels. As applications, we obtain a lower estimate of weighted $L^2$ integrals on sublevel sets of plurisubharmonic functions, and reprove an effectiveness result of the strong openness property of the modules.


title: an intelligent security centered resource-efficient resource management model for cloud computing environments

abstract: This paper proposes a conceptual model for a secure and performance-efficient workload management model in cloud environments. In this model, a resource management unit is employed for energy and performance proficient allocation of virtual machines while ensuring the secure processing of users' applications by defending against data breaches due to unauthorized access to virtual machines in real-time. The resource management unit is guided by a secure virtual machine management unit which is designed to generate information regarding unauthorized access or inter-communication links among active virtual machines. Also, a workload analyzer unit operates concurrently to estimate resource utilization information to assist the resource management unit in the performance-efficient allocation of virtual machines. Contrary to prior works which engage access control mechanisms, encryption, and decryption of data before the transfer and the use of tunneling for prevention of unauthorized access to virtual machines which raises excess computational cost overhead, the proposed model operates diversely for efficiently serving the same purpose.


title: Symmetric property and edge-disjoint Hamiltonian cycles of the spined cube

abstract: The spined cube $SQ_n$ is a variant of the hypercube $Q_n$, introduced by Zhou et al. in [Information Processing Letters 111 (2011) 561-567] as an interconnection network for parallel computing. A graph $\G$ is an $m$-Cayley graph if its automorphism group $\Aut(\G)$ has a semiregular subgroup acting on the vertex set with $m$ orbits, and is a Caley graph if it is a 1-Cayley graph. It is well-known that $Q_n$ is a Cayley graph of an elementary abelian 2-group $\mz_2^n$ of order $2^n$. In this paper, we prove that $SQ_n$ is a 4-Cayley graph of $\mz_2^{n-2}$ when $n\geq6$, and is a $\lfloor n/2\rfloor$-Cayley graph when $n\leq 5$. This symmetric property shows that an $n$-dimensional spined cube with $n\geq6$ can be decomposed to eight vertex-disjoint $(n-3)$-dimensional hypercubes, and as an application, it is proved that there exist two edge-disjoint Hamiltonian cycles in $SQ_n$ when $n\geq4$. Moreover, we determine the vertex-transitivity of $SQ_n$, and prove that $SQ_n$ is not vertex-transitive unless $n\leq3$.


title: A Critical Reflection and Forward Perspective on Empathy and Natural Language Processing

abstract: We review the state of research on empathy in natural language processing and identify the following issues: (1) empathy definitions are absent or abstract, which (2) leads to low construct validity and reproducibility. Moreover, (3) emotional empathy is overemphasized, skewing our focus to a narrow subset of simplified tasks. We believe these issues hinder research progress and argue that current directions will benefit from a clear conceptualization that includes operationalizing cognitive empathy components. Our main objectives are to provide insight and guidance on empathy conceptualization for NLP research objectives and to encourage researchers to pursue the overlooked opportunities in this area, highly relevant, e.g., for clinical and educational sectors.


title: On orthogonal polynomials with respect to a class of differential operators

abstract: We consider orthogonal polynomials with respect to a linear differential operator $$\mathcal{L}^{(M)}=\sum_{k=0}^{M}\rho_{k}(z)\frac{d^k}{dz^k}, $$ where $\{\rho_k\}_{k=0}^{M}$ are complex polynomials such that $deg[\rho_k]\leq k, 0\leq k \leq M$, with equality for at least one index. We analyze the uniqueness and zero location of these polynomials. An interesting phenomenon occurring in this kind of orthogonality is the existence of operators for which the associated sequence of orthogonal polynomials reduces to a finite set. For a given operator, we find a classification of the measures for which it is possible to guarantee the existence of an infinite sequence of orthogonal polynomials, in terms of a linear system of difference equations with varying coefficients. Also, for the case of a first-order differential operator, we locate the zeros and establish the strong asymptotic behavior of these polynomials.


title: Neural Combinatorial Logic Circuit Synthesis from Input-Output Examples

abstract: We propose a novel, fully explainable neural approach to synthesis of combinatorial logic circuits from input-output examples. The carrying advantage of our method is that it readily extends to inductive scenarios, where the set of examples is incomplete but still indicative of the desired behaviour. Our method can be employed for a virtually arbitrary choice of atoms - from logic gates to FPGA blocks - as long as they can be formulated in a differentiable fashion, and consistently yields good results for synthesis of practical circuits of increasing size. In particular, we succeed in learning a number of arithmetic, bitwise, and signal-routing operations, and even generalise towards the correct behaviour in inductive scenarios. Our method, attacking a discrete logical synthesis problem with an explainable neural approach, hints at a wider promise for synthesis and reasoning-related tasks.


title: Multibody expansion of the local integrals of motion: How many pairs of particle-hole do we really need to describe the quasiparticles in the many-body localized phase?

abstract: The emergent integrability in a many-body localized (MBL) system can be well characterized by the existence of the complete set of local integrals of motion (LIOMs). Such exactly conserved and exponentially localized operators are often understood as quasiparticle operators which can be expanded in terms of single-particle operators dressed with different numbers of particle-hole pairs. Here, we consider a one-dimensional XXZ spin-$\frac12$ Heisenberg chain in the presence of a random field and try to quantify the corrections needed to be considered in the picture of quasiparticles associated with LIOMs due to the presence of particle-hole excitations. To this end, we explicitly present the multibody expansion of LIOM creation operators of the system in the MBL regime. We analytically obtain the coefficients of this expansion and discuss the effect of higher-order corrections associated with different numbers of particle-hole excitations. Our analysis shows that depending on the localization length of the system, there exist a regime in which the contributions that come from higher-order terms can break down the effective one-particle description of the LIOMs and such quasiparticles become essentially many-body-like.


title: Benchmarking between fluid and global models for low-pressure oxygen DC glow discharges

abstract: This work focuses on the benchmarking between a zero-dimensional (0D) global model (LoKI) and a one-dimensional (1D) radial fluid model for the positive column of oxygen DC glow discharges in a tube of 1 cm inner radius at pressures between 0.5 Torr and 10 Torr. The data used in the two models are the same, so that the difference between the models is reduced to dimensionality. A good agreement is found between the two models on the main discharge parameters, with relative differences below 5%. The agreement on species average number densities, charged and neutral, is slightly worse, with relative differences increasing with pressure from 11% at 0.5 Torr to 57% at 10 Torr. The success of the 0D global model in describing these plasmas through volume averaged quantities decreases with pressure, due to pressure-driven narrowing of radial profiles. Hence, in the studied conditions, we recommend the use of volume-averaged models only in the pressure range up to 10 Torr.


title: $\mathcal{H}^2$-matrices for translation-invariant kernel functions

abstract: Boundary element methods for elliptic partial differential equations typically lead to boundary integral operators with translation-invariant kernel functions. Taking advantage of this property is fairly simple for particle methods, e.g., Nystrom-type discretizations, but more challenging if the supports of basis functions have to be taken into account. In this article, we present a modified construction for $\mathcal{H}^2$-matrices that uses translation-invariance to significantly reduce the storage requirements. Due to the uniformity of the boxes used for the construction, we need only a few uncomplicated assumptions to prove estimates for the resulting storage complexity.


title: Optimistic and Validity Rollups: Analysis and Comparison between Optimism and StarkNet

abstract: The thesis addresses the problem of scalability in decentralized blockchains in the context of the trade-off between transaction throughput and hardware requirements to participate in the network. Rollups are presented, that is technologies to verify on-chain blocks executed off-chain by minimizing the assumptions of trust. The variant of the Optimistic Rollups, in particular of Optimism and the use of invalidity proofs through interactive binary search and of the Validity Rollups, in particular of StarkNet, and the use of validity proofs through STARKs are discussed. Finally, the two solutions are compared on withdrawal time, on the cost of transactions and techniques to minimize it, on the possibility of applying the technology recursively, on compatibility with Ethereum and on the licenses used.


title: Application of Knowledge Distillation to Multi-task Speech Representation Learning

abstract: Model architectures such as wav2vec 2.0 and HuBERT have been proposed to learn speech representations from audio waveforms in a self-supervised manner. When they are combined with downstream tasks such as keyword spotting and speaker verification, they provide state-of-the-art performance. However, these models use a large number of parameters, the smallest version of which has 95 million parameters. This constitutes a challenge for edge AI device deployments. In this paper, we investigate the application of knowledge distillation to speech representation learning (SRL) models followed by joint fine-tuning with multiple downstream voice-activated tasks. In our experiments on two such tasks, our approach results in nearly 75% reduction in model size while suffering only 0.1% accuracy and 0.9% equal error rate degradation compared to the full-size model. In addition, we show that fine-tuning the SRL models results in a significant performance boost compared to using frozen SRL models.


title: Weak Galerkin Finite Element Methods for Quad-Curl Problems

abstract: This article introduces a weak Galerkin (WG) finite element method for quad-curl problems in three dimensions. It is proved that the proposed WG method is stable and accurate in an optimal order of error estimates for the exact solution in discrete norms. In addition, an $L^2$ error estimate in an optimal order except the lowest orders $k=1, 2$ is derived for the WG solution. Some numerical experiments are conducted to verify the efficiency and accuracy of our WG method and furthermore a superconvergence has been observed from the numerical results.


title: Diverse Parallel Data Synthesis for Cross-Database Adaptation of Text-to-SQL Parsers

abstract: Text-to-SQL parsers typically struggle with databases unseen during the train time. Adapting parsers to new databases is a challenging problem due to the lack of natural language queries in the new schemas. We present ReFill, a framework for synthesizing high-quality and textually diverse parallel datasets for adapting a Text-to-SQL parser to a target schema. ReFill learns to retrieve-and-edit text queries from the existing schemas and transfers them to the target schema. We show that retrieving diverse existing text, masking their schema-specific tokens, and refilling with tokens relevant to the target schema, leads to significantly more diverse text queries than achievable by standard SQL-to-Text generation methods. Through experiments spanning multiple databases, we demonstrate that fine-tuning parsers on datasets synthesized using ReFill consistently outperforms the prior data-augmentation methods.


title: Topological symplectic Kondo effect

abstract: Multiple conduction channels interacting with a quantum impurity -- a spin in the conventional ``multi-channel Kondo effect'' or a topological mesoscopic device (``topological Kondo effect'') -- has been proposed as a platform to realize anyonic quasi-particles. However, the above implementations require either perfect channel symmetry or the use of Majorana fermions. Here we propose a Majorana-free mesoscopic setup which implements the Kondo effect of the symplectic Lie group and can harbor emergent anyons (including Majorana fermions, Fibonacci anyons, and $\mathbb Z_3$ parafermions) even in the absence of perfect channel symmetry. In addition to the detailed prescription of the implementation, we present the strong coupling solution by mapping the model to the multi-channel Kondo effect associated to an internal $SU(2)$ symmetry and exploit conformal field theory (CFT) to predict the non-trivial scaling of a variety of observables, including conductance, as a function of temperature. This work does not only open the door for robust Kondo-based anyon platforms, but also sheds light on the physics of strongly correlated materials with competing order parameters.


title: Progress on levitating a sphere in cryogenic fluids

abstract: We present the working prototype of a levitation system designed for investigation of flows in cryogenic helium fluids. The current device allows the levitation of a superconducting sphere and has several provisions made for allowing precise control over its motion. We report on progress in the detection and control systems of the prototype and demonstrate how uniform circular motion can be implemented.


title: Observation of Negative Surface and Interface Energies of Quantum Dots

abstract: Surface energy is a fundamental property of materials and is particularly important in describing nanomaterials where atoms or molecules at the surface constitute a large fraction of the material. Traditionally, surface energy is considered to be a positive quantity, where atoms or molecules at the surface are less thermodynamically stable than their counterparts in the interior of the material because they have fewer bonds or interactions at the surface. Using calorimetric methods, we show that the surface energy is negative in some prototypical colloidal semiconductor nanocrystals, or quantum dots with organic ligand coatings. This implies that the surface atoms are more thermodynamically stable than those on the interior due to the strong bonds between these atoms and surfactant molecules, or ligands, that coat their surface. In addition, we extend this work to core/shell indium phosphide/zinc sulfide nanocrystals and show that the interfacial energy between these materials is highly thermodynamically favorable in spite of their large lattice mismatch. This work challenges many of the assumptions that have guided thinking about colloidal nanomaterial thermodynamics, investigates the fundamental stability of many technologically relevant colloidal nanomaterials, and paves the way for future experimental and theoretical work on nanocrystal thermodynamics.


title: Spectral properties of an acoustic-elastic transmission eigenvalue problem with applications

abstract: We are concerned with a coupled-physics spectral problem arising in the coupled propagation of acoustic and elastic waves, which is referred to as the acoustic-elastic transmission eigenvalue problem. There are two major contributions in this work which are new to the literature. First, under a mild condition on the medium parameters, we prove the existence of an acoustic-elastic transmission eigenvalue. Second, we establish a geometric rigidity result of the transmission eigenfunctions by showing that they tend to localize on the boundary of the underlying domain. Moreover, we also consider interesting implications of the obtained results to the effective construction of metamaterials by using bubbly elastic structures and to the inverse problem associated with the fluid-structure interaction.


title: Multidimensional coherent spectroscopy of excitons in $\pi$-conjugated polymers

abstract: The photophysics of $\pi$-conjugated polymers has been of considerable interest over the last three decades because of their organic semiconductor properties. Primary photoexcitations, Frenkel excitons, can be probed optically by means of numerous linear spectroscopies, providing a wealth of information on the the strength of excitonic coupling, the exciton coherence length, and on the nature of the disordered energy landscape. Nonetheless, there are intrinsic limitations in the information that can be obtained with linear spectroscopy compared to non-linear coherent techniques. Examples of this are the separation of homogeneous and inhomogeneous broadening contributions to the total exciton spectral lineshape, the detailed spectral structure of exciton-vibrational coupling, and correlations between optical excitations, including exciton-charge and exciton-exciton correlations. In the present work, we discuss the role of two-dimensional coherent excitation spectroscopy and review its applications towards unravelling the basic photophysics of $\pi$-conjugated polymers as well as polymer:fullerene blends, and we argue that these techniques are now valuable mainstream materials optical probes.


title: Peculiarities of the local structure in new medium- and high-entropy, low-symmetry tungstates

abstract: New monoclinic ($P2$/$c$) tungstates - a medium-entropy tungstate, (Mn,Ni,Cu,Zn)WO$_4$, and a high-entropy tungstate, (Mn,Co,Ni,Cu,Zn)WO$_4$ - were synthesized and characterized. Their phase purity and solid solution nature were confirmed by powder X-ray diffraction and Raman spectroscopy. X-ray absorption spectroscopy was used to probe the local structure around metal cations. The atomic structures based on the ideal solid solution model were optimized by a simultaneous analysis of the extended X-ray absorption fine structure spectra at multiple metal absorption edges - five for (Mn,Ni,Cu,Zn)WO$_4$ and six for (Mn,Co,Ni,Cu,Zn)WO$_4$ - by means of reverse Monte Carlo simulations. In both compounds, Ni$^{2+}$ ions have the strongest tendency to organize their local environment and form slightly distorted [NiO$_6$] octahedra, whereas Mn$^{2+}$, Co$^{2+}$, and Zn$^{2+}$ ions have a strongly distorted octahedral coordination. The most intriguing result is that the shape of [CuO$_6$] octahedra in (Mn,Ni,Cu,Zn)WO$_4$ and (Mn,Co,Ni,Cu,Zn)WO$_4$ differs from that found in pure CuWO$_4$, where a strong Jahn-Teller distortion is present: [CuO$_6$] octahedra become more regular with increasing degree of dilution.


title: Ricci Flow method in the existence problem of the K"ahler-Einstein metrics

abstract: This note illustrates the Ricci flow method based on the Cao.H.D's paper[1] and Yau.S.T's paper[4], and tries to explain the method in detail, especially in some calculations. Jian Song and Weinkove's note[9] used some other estimates to obtain the result, this paper will explain some of their estimates as well. This note was a seminar lecture note in 2022 summer when the author was giving lectures on the geometry analysis seminar reasearching the Ricci flow method. The part of the imporatnt zero order estimate is going to be added in a few days. The level of the author is limited, if there are any errors, please do not hesitate to advise. Any comments will be grateful.


title: Empirical Evaluation of Post-Training Quantization Methods for Language Tasks

abstract: Transformer-based architectures like BERT have achieved great success in a wide range of Natural Language tasks. Despite their decent performance, the models still have numerous parameters and high computational complexity, impeding their deployment in resource-constrained environments. Post-Training Quantization (PTQ), which enables low-bit computations without extra training, could be a promising tool. In this work, we conduct an empirical evaluation of three PTQ methods on BERT-Base and BERT-Large: Linear Quantization (LQ), Analytical Clipping for Integer Quantization (ACIQ), and Outlier Channel Splitting (OCS). OCS theoretically surpasses the others in minimizing the Mean Square quantization Error and avoiding distorting the weights' outliers. That is consistent with the evaluation results of most language tasks of GLUE benchmark and a reading comprehension task, SQuAD. Moreover, low-bit quantized BERT models could outperform the corresponding 32-bit baselines on several small language tasks, which we attribute to the alleviation of over-parameterization. We further explore the limit of quantization bit and show that OCS could quantize BERT-Base and BERT-Large to 3-bits and retain 98% and 96% of the performance on the GLUE benchmark accordingly. Moreover, we conduct quantization on the whole BERT family, i.e., BERT models in different configurations, and comprehensively evaluate their performance on the GLUE benchmark and SQuAD, hoping to provide valuable guidelines for their deployment in various computation environments.


title: Discriminative Speaker Representation via Contrastive Learning with Class-Aware Attention in Angular Space

abstract: The challenges in applying contrastive learning to speaker verification (SV) are that the softmax-based contrastive loss lacks discriminative power and that the hard negative pairs can easily influence learning. To overcome the first challenge, we propose a contrastive learning SV framework incorporating an additive angular margin into the supervised contrastive loss in which the margin improves the speaker representation's discrimination ability. For the second challenge, we introduce a class-aware attention mechanism through which hard negative samples contribute less significantly to the supervised contrastive loss. We also employed gradient-based multi-objective optimization to balance the classification and contrastive loss. Experimental results on CN-Celeb and Voxceleb1 show that this new learning objective can cause the encoder to find an embedding space that exhibits great speaker discrimination across languages.


title: Predicting dynamic heterogeneity in glass-forming liquids by physics-inspired machine learning

abstract: We introduce GlassMLP, a machine learning framework using physics-inspired structural input to predict the long-time dynamics in deeply supercooled liquids. We apply this deep neural network to atomistic models in 2D and 3D. Its performance is better than the state of the art while being more parsimonious in terms of training data and fitting parameters. GlassMLP quantitatively predicts four-point dynamic correlations and the geometry of dynamic heterogeneity. Transferability across system sizes allows us to efficiently probe the temperature evolution of spatial dynamic correlations, revealing a profound change with temperature in the geometry of rearranging regions.


title: LearningGroup: A Real-Time Sparse Training on FPGA via Learnable Weight Grouping for Multi-Agent Reinforcement Learning

abstract: Multi-agent reinforcement learning (MARL) is a powerful technology to construct interactive artificial intelligent systems in various applications such as multi-robot control and self-driving cars. Unlike supervised model or single-agent reinforcement learning, which actively exploits network pruning, it is obscure that how pruning will work in multi-agent reinforcement learning with its cooperative and interactive characteristics. \par In this paper, we present a real-time sparse training acceleration system named LearningGroup, which adopts network pruning on the training of MARL for the first time with an algorithm/architecture co-design approach. We create sparsity using a weight grouping algorithm and propose on-chip sparse data encoding loop (OSEL) that enables fast encoding with efficient implementation. Based on the OSEL's encoding format, LearningGroup performs efficient weight compression and computation workload allocation to multiple cores, where each core handles multiple sparse rows of the weight matrix simultaneously with vector processing units. As a result, LearningGroup system minimizes the cycle time and memory footprint for sparse data generation up to 5.72x and 6.81x. Its FPGA accelerator shows 257.40-3629.48 GFLOPS throughput and 7.10-100.12 GFLOPS/W energy efficiency for various conditions in MARL, which are 7.13x higher and 12.43x more energy efficient than Nvidia Titan RTX GPU, thanks to the fully on-chip training and highly optimized dataflow/data format provided by FPGA. Most importantly, the accelerator shows speedup up to 12.52x for processing sparse data over the dense case, which is the highest among state-of-the-art sparse training accelerators.


title: Gray/dark soliton behavior and population under a symmetric and asymmetric potential trap

abstract: We numerically study the impact of Gaussian barrier height and width on the gray solitons population in a symmetric and asymmetric potential trap. The gray solitons are created in a double-well potential by the density engineering method. Two identical Bose-Einstein condensate fragments are confined and made to collide by switching off the Gaussian barrier in a double-well potential. We find that the gray solitons population can be manipulated by Gaussian barrier height and width. We also study the gray solitons population dependence on the coupling strength. Moreover, we also study the impact of an asymmetry present in the double-well potential. We observe that such an asymmetry always swings the point of collision of the gray solitons. Later, a stationary dark soliton is created by the phase imprinting method and we observe that the initial asymmetry in the double-well potential trap sets the dark soliton into oscillation.


title: Acoustic amplifying diode using non-reciprocal Willis coupling

abstract: We propose a concept called acoustic amplifying diode in combining both signal isolation and amplification in a single device. The signal is exponentially amplified in one direction with no reflection and is completely absorbed in another. In this case, the reflection is eliminated from the device in both directions due to impedance matching, preventing backscattering to the signal source. Here, we experimentally demonstrate the amplifying diode using an active metamaterial with non-reciprocal Willis coupling. We also discuss the situation with the presence of both reciprocal and non-reciprocal Willis couplings for more flexibility in implementation. The concept of acoustic amplifying diode will enable applications in sound isolation, sensing and communication, in which non-reciprocity can play an important role.


title: TFormer: 3D Tooth Segmentation in Mesh Scans with Geometry Guided Transformer

abstract: Optical Intra-oral Scanners (IOS) are widely used in digital dentistry, providing 3-Dimensional (3D) and high-resolution geometrical information of dental crowns and the gingiva. Accurate 3D tooth segmentation, which aims to precisely delineate the tooth and gingiva instances in IOS, plays a critical role in a variety of dental applications. However, segmentation performance of previous methods are error-prone in complicated tooth-tooth or tooth-gingiva boundaries, and usually exhibit unsatisfactory results across various patients, yet the clinically applicability is not verified with large-scale dataset. In this paper, we propose a novel method based on 3D transformer architectures that is evaluated with large-scale and high-resolution 3D IOS datasets. Our method, termed TFormer, captures both local and global dependencies among different teeth to distinguish various types of teeth with divergent anatomical structures and confusing boundaries. Moreover, we design a geometry guided loss based on a novel point curvature to exploit boundary geometric features, which helps refine the boundary predictions for more accurate and smooth segmentation. We further employ a multi-task learning scheme, where an additional teeth-gingiva segmentation head is introduced to improve the performance. Extensive experimental results in a large-scale dataset with 16,000 IOS, the largest IOS dataset to our best knowledge, demonstrate that our TFormer can surpass existing state-of-the-art baselines with a large margin, with its utility in real-world scenarios verified by a clinical applicability test.


title: Structure preserving schemes for Fokker-Planck equations of irreversible processes

abstract: In this paper, we introduce second order and fourth order space discretization via finite difference implementation of the finite element method for solving Fokker-Planck equations associated with irreversible processes. The proposed schemes are first order in time and second order and fourth order in space. Under mild mesh conditions and time step constraints for smooth solutions, the schemes are proved to be monotone, thus are positivity-preserving and energy dissipative. In particular, our scheme is suitable for capturing steady state solutions in large final time simulations.


title: Electronic transport in graphene with out-of-plane disorder

abstract: Real-world samples of graphene often exhibit various types of out-of-plane disorder -- ripples, wrinkles and folds -- introduced at the stage of growth and transfer processes. These complex out-of-plane defects resulting from the interplay between self-adhesion of graphene and its bending rigidity inevitably lead to the scattering of charge carriers thus affecting the electronic transport properties of graphene. We address the ballistic charge-carrier transmission across the models of out-of-plane defects using tight-binding and density functional calculations while fully taking into account lattice relaxation effects. The observed transmission oscillations in commensurate graphene wrinkles are attributed to the interference between intra- and interlayer transport channels, while the incommensurate wrinkles show vanishing backscattering and retain the transport properties of flat graphene. The suppression of backscattering reveals the crucial role of lattice commensuration in the electronic transmission. Our results provide guidelines to controlling the transport properties of graphene in presence of this ubiquitous type of disorder.


title: Retroreflection and diffraction of a Bose-Einstein condensate by evanescent standing wave potential

abstract: The characteristic of the angular distributions of accelerated Bose-Einstein condensate (BEC) atoms incidence on the surface is designed using the mathematical modeling method. Here, we proposed the idea to study the retroreflection and diffraction of a BEC from an evanescent standing wave potential (ESWP). The ESWP is formed by multiple reflections of the laser beam from the surface of the prism under the influence of gravity. After BEC's reflection and diffraction, the so-called BEC's density rainbow patterns develop due to the interference which depends on the surface structure which we model with the periodic decaying evanescent field. The interaction of accelerated bosonic atoms with a surface can help to demonstrate surface structures or to determine surface roughness, or to build future high spatial resolution and high sensitivity magnetic-field sensors in two-dimensional systems.


title: K-stability for varieties with a big anticanonical class

abstract: We extend the algebraic K-stability theory to projective klt pairs with a big anticanonical class. While in general such a pair could behave pathologically, it is observed in this note that K-semistability condition will force them to have a klt anticanonical model, whose stability property is the same as the original pair.


title: Certifying randomness in quantum state collapse

abstract: The unpredictable process of state collapse caused by quantum measurements makes the generation of quantum randomness possible. In this paper, we explore the quantitive connection between the randomness generation and the state collapse and provide a randomness verification protocol under the assumptions: (I) independence between the source and the measurement devices and (II) the L\"{u}ders' rule for collapsing state. Without involving heavy mathematical machinery, the amount of genereted quantum randomness can be directly estimated with the disturbance effect originating from the state collapse. In the protocol, we can employ general measurements that are not fully trusted. Equipped with trusted projection measurements, we can further optimize the randomness generation performance. Our protocol also shows a high efficiency and yields a higher randomness generation rate than the one based on uncertainty relation. We expect our results to provide new insights for understanding and generating quantum randomness


title: Probing the Plasma Tail of Interstellar Comet 2I/Borisov

abstract: We present an occultation study of compact radio sources by the plasma tail of interstellar Comet 2I/Borisov (C/2019 Q4) both pre- and near-perihelion using the Arecibo and Green Bank radio telescopes. The interplanetary scintillation (IPS) technique was used to probe the plasma tail at P-band (302--352 MHz), 820 MHz, and L-band (1120--1730 MHz). The presence and absence of scintillation at different perpendicular distances from the central axis of the plasma tail suggests a narrow tail of less than 6~arcmin at a distance of $\sim$10~arcmin ($\sim$$10^6$~km) from the comet nucleus. Data recorded during the occultation of B1019+083 on 31 October 2019 with the Arecibo Telescope covered the width of the plasma tail from its outer region to the central axis. The systematic increase in scintillation during the occultation provides the plasma properties associated with the tail when the comet was at its pre-perihelion phase. The excess level of L-band scintillation indicates a plasma density enhancement of $\sim$15--20 times that of the background solar wind. The evolving shape of the observed scintillation power spectra across the tail from its edge to the central axis suggests a density spectrum flatter than Kolmogorov, and that the plasma-density irregularity scales present in the tail range between 10 and 700 km. The discovery of a high-frequency spectral excess, corresponding to irregularity scales much smaller than the Fresnel scale, suggests the presence of small-scale density structures in the plasma tail, likely caused by interaction between the solar wind and the plasma environment formed by the comet.


title: Distributed Estimation and Inference for Spatial Autoregression Model with Large Scale Networks

abstract: The rapid growth of online network platforms generates large-scale network data and it poses great challenges for statistical analysis using the spatial autoregression (SAR) model. In this work, we develop a novel distributed estimation and statistical inference framework for the SAR model on a distributed system. We first propose a distributed network least squares approximation (DNLSA) method. This enables us to obtain a one-step estimator by taking a weighted average of local estimators on each worker. Afterwards, a refined two-step estimation is designed to further reduce the estimation bias. For statistical inference, we utilize a random projection method to reduce the expensive communication cost. Theoretically, we show the consistency and asymptotic normality of both the one-step and two-step estimators. In addition, we provide theoretical guarantee of the distributed statistical inference procedure. The theoretical findings and computational advantages are validated by several numerical simulations implemented on the Spark system. Lastly, an experiment on the Yelp dataset further illustrates the usefulness of the proposed methodology.


title: A bijection between rooted planar maps and generalized fighting fish

abstract: The class of fighting fish is a recently introduced model of branching surfaces generalizing parallelogram polyominoes. We can alternatively see them as gluings of cells, walks on the square lattice confined to the quadrant or shuffle of Dyck words. With these different points of view, we introduce a natural extension of fighting fish that we call \emph{generalized fighting fish}. We show that generalized fighting fish are exactly the Mullin codes of rooted planar maps endowed with their unique rightmost depth-first search spanning tree, also known as Lehman-Lenormand code. In particular, this correspondence gives a bijection between fighting fish and nonseparable rooted planar maps, enriching the garden of bijections between classes of objects enumerated by the sequence $\frac{2}{(n+1)(2n+1)} \binom{3n}{n}$.


title: Speaker Representation Learning via Contrastive Loss with Maximal Speaker Separability

abstract: A great challenge in speaker representation learning using deep models is to design learning objectives that can enhance the discrimination of unseen speakers under unseen domains. This work proposes a supervised contrastive learning objective to learn a speaker embedding space by effectively leveraging the label information in the training data. In such a space, utterance pairs spoken by the same or similar speakers will stay close, while utterance pairs spoken by different speakers will be far apart. For each training speaker, we perform random data augmentation on their utterances to form positive pairs, and utterances from different speakers form negative pairs. To maximize speaker separability in the embedding space, we incorporate the additive angular-margin loss into the contrastive learning objective. Experimental results on CN-Celeb show that this new learning objective can cause ECAPA-TDNN to find an embedding space that exhibits great speaker discrimination. The contrastive learning objective is easy to implement, and we provide PyTorch code at https://github.com/shanmon110/AAMSupCon.


title: Beyond Prompting: Making Pre-trained Language Models Better Zero-shot Learners by Clustering Representations

abstract: Recent work has demonstrated that pre-trained language models (PLMs) are zero-shot learners. However, most existing zero-shot methods involve heavy human engineering or complicated self-training pipelines, hindering their application to new situations. In this work, we show that zero-shot text classification can be improved simply by clustering texts in the embedding spaces of PLMs. Specifically, we fit the unlabeled texts with a Bayesian Gaussian Mixture Model after initializing cluster positions and shapes using class names. Despite its simplicity, this approach achieves superior or comparable performance on both topic and sentiment classification datasets and outperforms prior works significantly on unbalanced datasets. We further explore the applicability of our clustering approach by evaluating it on 14 datasets with more diverse topics, text lengths, and numbers of classes. Our approach achieves an average of 20% absolute improvement over prompt-based zero-shot learning. Finally, we compare different PLM embedding spaces and find that texts are well-clustered by topics even if the PLM is not explicitly pre-trained to generate meaningful sentence embeddings. This work indicates that PLM embeddings can categorize texts without task-specific fine-tuning, thus providing a new way to analyze and utilize their knowledge and zero-shot learning ability.


title: Iterations and unions of star selection properties on topological spaces

abstract: In this paper, we investigate what selection principles properties are possessed by small (with respect to the bounding and dominating numbers) unions of spaces with certain (star) selection principles.. Furthermore, we give several results about iterations of these properties and weaker properties than paracompactness. In addition, we study the behaviour of these iterated properties on $\Psi$-spaces. Finally, we show that, consistently, there is a normal star-Menger space that is not strongly star-Menger.


title: GRACE: Loss-Resilient Real-Time Video Communication Using Data-Scalable Autoencoder

abstract: Across many real-time video applications, we see a growing need (especially in long delays and dynamic bandwidth) to allow clients to decode each frame once any (non-empty) subset of its packets is received and improve quality with each new packet. We call it data-scalable delivery. Unfortunately, existing techniques (e.g., FEC, RS and Fountain Codes) fall short: they require either delivery of a minimum number of packets to decode frames, and/or pad video data with redundancy in anticipation of packet losses, which hurts video quality if no packets get lost. This work explores a new approach, inspired by recent advances of neural-network autoencoders, which make data-scalable delivery possible. We present Grace, a concrete data-scalable real-time video system. With the same video encoding, Grace's quality is slightly lower than traditional codec without redundancy when no packet is lost, but with each missed packet, its quality degrades much more gracefully than existing solutions, allowing clients to flexibly trade between frame delay and video quality. Grace makes two contributions: (1) it trains new custom autoencoders to balance compression efficiency and resilience against a wide range of packet losses; and (2) it uses a new transmission scheme to deliver autoencoder-coded frames as individually decodable packets. We test Grace (and traditional loss-resilient schemes and codecs) on real network traces and videos, and show that while Grace's compression efficiency is slightly worse than heavily engineered video codecs, it significantly reduces tail video frame delay (by 2$\times$ at the 95th percentile) with the marginally lowered video quality


title: 2D and 3D CT Radiomic Features Performance Comparison in Characterization of Gastric Cancer: A Multi-center Study

abstract: Objective: Radiomics, an emerging tool for medical image analysis, is potential towards precisely characterizing gastric cancer (GC). Whether using one-slice 2D annotation or whole-volume 3D annotation remains a long-time debate, especially for heterogeneous GC. We comprehensively compared 2D and 3D radiomic features' representation and discrimination capacity regarding GC, via three tasks. Methods: Four-center 539 GC patients were retrospectively enrolled and divided into the training and validation cohorts. From 2D or 3D regions of interest (ROIs) annotated by radiologists, radiomic features were extracted respectively. Feature selection and model construction procedures were customed for each combination of two modalities (2D or 3D) and three tasks. Subsequently, six machine learning models (Model_2D^LNM, Model_3D^LNM; Model_2D^LVI, Model_3D^LVI; Model_2D^pT, Model_3D^pT) were derived and evaluated to reflect modalities' performances in characterizing GC. Furthermore, we performed an auxiliary experiment to assess modalities' performances when resampling spacing is different. Results: Regarding three tasks, the yielded areas under the curve (AUCs) were: Model_2D^LNM's 0.712 (95% confidence interval, 0.613-0.811), Model_3D^LNM's 0.680 (0.584-0.775); Model_2D^LVI's 0.677 (0.595-0.761), Model_3D^LVI's 0.615 (0.528-0.703); Model_2D^pT's 0.840 (0.779-0.901), Model_3D^pT's 0.813 (0.747-0.879). Moreover, the auxiliary experiment indicated that Models_2D are statistically more advantageous than Models3D with different resampling spacings. Conclusion: Models constructed with 2D radiomic features revealed comparable performances with those constructed with 3D features in characterizing GC. Significance: Our work indicated that time-saving 2D annotation would be the better choice in GC, and provided a related reference to further radiomics-based researches.


title: Description and performance results of the trigger logic of TUS and Mini-EUSO to search for Ultra-High Energy Cosmic Rays from space

abstract: The trigger logic of the Tracking Ultraviolet Setup (TUS) and Multiwavelength Imaging New Instrument for the Extreme Universe Space Observatory (Mini-EUSO) space-based projects of the Joint Experiment Missions - EUSO (JEM-EUSO) program is summarized. The performance results on the search for ultra-high energy cosmic rays are presented.


title: Unifying the Discrete and Continuous Emotion labels for Speech Emotion Recognition

abstract: Traditionally, in paralinguistic analysis for emotion detection from speech, emotions have been identified with discrete or dimensional (continuous-valued) labels. Accordingly, models that have been proposed for emotion detection use one or the other of these label types. However, psychologists like Russell and Plutchik have proposed theories and models that unite these views, maintaining that these representations have shared and complementary information. This paper is an attempt to validate these viewpoints computationally. To this end, we propose a model to jointly predict continuous and discrete emotional attributes and show how the relationship between these can be utilized to improve the robustness and performance of emotion recognition tasks. Our approach comprises multi-task and hierarchical multi-task learning frameworks that jointly model the relationships between continuous-valued and discrete emotion labels. Experimental results on two widely used datasets (IEMOCAP and MSPPodcast) for speech-based emotion recognition show that our model results in statistically significant improvements in performance over strong baselines with non-unified approaches. We also demonstrate that using one type of label (discrete or continuous-valued) for training improves recognition performance in tasks that use the other type of label. Experimental results and reasoning for this approach (called the mismatched training approach) are also presented.


title: XNOR-FORMER: Learning Accurate Approximations in Long Speech Transformers

abstract: Transformers are among the state of the art for many tasks in speech, vision, and natural language processing, among others. Self-attentions, which are crucial contributors to this performance have quadratic computational complexity, which makes training on longer input sequences challenging. Prior work has produced state-of-the-art transformer variants with linear attention, however, current models sacrifice performance to achieve efficient implementations. In this work, we develop a novel linear transformer by examining the properties of the key-query product within self-attentions. Our model outperforms state of the art approaches on speech recognition and speech summarization, resulting in 1 % absolute WER improvement on the Librispeech-100 speech recognition benchmark and a new INTERVIEW speech recognition benchmark, and 5 points on ROUGE for summarization with How2.


title: Unsupervised Audio-Visual Lecture Segmentation

abstract: Over the last decade, online lecture videos have become increasingly popular and have experienced a meteoric rise during the pandemic. However, video-language research has primarily focused on instructional videos or movies, and tools to help students navigate the growing online lectures are lacking. Our first contribution is to facilitate research in the educational domain, by introducing AVLectures, a large-scale dataset consisting of 86 courses with over 2,350 lectures covering various STEM subjects. Each course contains video lectures, transcripts, OCR outputs for lecture frames, and optionally lecture notes, slides, assignments, and related educational content that can inspire a variety of tasks. Our second contribution is introducing video lecture segmentation that splits lectures into bite-sized topics that show promise in improving learner engagement. We formulate lecture segmentation as an unsupervised task that leverages visual, textual, and OCR cues from the lecture, while clip representations are fine-tuned on a pretext self-supervised task of matching the narration with the temporally aligned visual content. We use these representations to generate segments using a temporally consistent 1-nearest neighbor algorithm, TW-FINCH. We evaluate our method on 15 courses and compare it against various visual and textual baselines, outperforming all of them. Our comprehensive ablation studies also identify the key factors driving the success of our approach.


title: Solving a Special Type of Optimal Transport Problem by a Modified Hungarian Algorithm

abstract: Computing the empirical Wasserstein distance in the Wasserstein-distance-based independence test is an optimal transport (OT) problem with a special structure. This observation inspires us to study a special type of OT problem and propose a modified Hungarian algorithm to solve it exactly. For the OT problem involving two marginals with $m$ and $n$ atoms ($m\geq n$), respectively, the computational complexity of the proposed algorithm is $O(m^2n)$. Computing the empirical Wasserstein distance in the independence test requires solving this special type of OT problem, where $m=n^2$. The associated computational complexity of the proposed algorithm is $O(n^5)$, while the order of applying the classic Hungarian algorithm is $O(n^6)$. In addition to the aforementioned special type of OT problem, it is shown that the modified Hungarian algorithm could be adopted to solve a wider range of OT problems. Broader applications of the proposed algorithm are discussed -- solving the one-to-many assignment problem and the many-to-many assignment problem. We conduct numerical experiments to validate our theoretical results. The experiment results demonstrate that the proposed modified Hungarian algorithm compares favorably with the Hungarian algorithm, the well-known Sinkhorn algorithm, and the network simplex algorithm.


title: Breaking the Symmetry: Resolving Symmetry Ambiguities in Equivariant Neural Networks

abstract: Equivariant networks have been adopted in many 3-D learning areas. Here we identify a fundamental limitation of these networks: their ambiguity to symmetries. Equivariant networks cannot complete symmetry-dependent tasks like segmenting a left-right symmetric object into its left and right sides. We tackle this problem by adding components that resolve symmetry ambiguities while preserving rotational equivariance. We present OAVNN: Orientation Aware Vector Neuron Network, an extension of the Vector Neuron Network. OAVNN is a rotation equivariant network that is robust to planar symmetric inputs. Our network consists of three key components. 1) We introduce an algorithm to calculate symmetry detecting features. 2) We create a symmetry-sensitive orientation aware linear layer. 3) We construct an attention mechanism that relates directional information across points. We evaluate the network using left-right segmentation and find that the network quickly obtains accurate segmentations. We hope this work motivates investigations on the expressivity of equivariant networks on symmetric objects.


title: Evolution and Function of SMC Proteins

abstract: Structural Maintenance of Chromosomes, SMCs, proteins have long rod like structures immersed in water. Here we use our hydroanalytic methods based on amino acid sequences to discuss their dynamics at multiple length scales identified by evolution. The length scales are 10 to 100 times longer than used in normal studies of sequence evolution. Their hydropathic profiles exhibit many features unique to their structure and function.


title: The general static spherical perfect fluid solution with EoS parameter w=-1/6

abstract: The general analytical solution for the static spherically symmetric metric supported by a perfect fluid with proportional-equation-of-state $p = w \rho$ is not known at the time of this writing, except for the trivial cases $w=0$ and $w=-1$; for $w=-1/3$, and the recently reported $w=-1/5$. We show that the case $w=-1/6$ is also analytically solvable, as predicted in another recent work. The solution is affected by a Buchdahl transformation of a known solution.


title: Interactive cohort exploration for spinocerebellar ataxias using synthetic cohort data for visualization

abstract: Motivation: Visualization of data is a crucial step to understanding and deriving hypotheses from clinical data. However, for clinicians, visualization often comes with great effort due to the lack of technical knowledge about data handling and visualization. The application offers an easy-to-use solution with an intuitive design that enables various kinds of plotting functions. The aim was to provide an intuitive solution with a low entrance barrier for clinical users. Little to no onboarding is required before creating plots, while the complexity of questions can grow up to specific corner cases. To allow for an easy start and testing with SCAview, we incorporated a synthetic cohort dataset based on real data of rare neurological movement disorders: the most common autosomal-dominantly inherited spinocerebellar ataxias (SCAs) type 1, 2, 3, and 6 (SCA1, 2, 3 and 6). Methods: We created a Django-based backend application that serves the data to a React-based frontend that uses Plotly for plotting. A synthetic cohort was created to deploy a version of SCAview without violating any data protection guidelines. Here, we added normal distributed noise to the data and therefore prevent re-identification while keeping distributions and general correlations. Results: This work presents SCAview, an user-friendly, interactive web-based service that enables data visualization in a clickable interface allowing intuitive graphical handling that aims to enable data visualization in a clickable interface. The service is deployed and can be tested with a synthetic cohort created based on a large, longitudinal dataset from observational studies in the most common SCAs.


title: The GMRT High Resolution Southern Sky Survey for pulsars and transients $-$ IV: Discovery of 4 new pulsars with an FFA search

abstract: The fast Fourier transform (FFT) based periodicity search methods provide an efficient way to search for millisecond and binary pulsars but encounter significant sensitivity degradation while searching for long period and short duty cycle pulsars. An alternative to FFT-based search methods called the Fast Folding Algorithm (FFA) search, provides superior sensitivity to search for signals with long periods and short duty cycles. In the GMRT High Resolution Southern Sky (GHRSS) survey, we are using an FFA-based pipeline to search for isolated pulsars in a period range of 100 ms to 100 s. We have processed 2800 degree$^2$ of the sky coverage away from the Galactic plane and discovered 6 new pulsars. Here, we report the discovery of 4 of these pulsars with the FFA search pipeline. This includes a narrow duty cycle pulsar, J1936$-$30, which shows nulling behavior with an extreme nulling fraction of $\sim 90\%$. Two of the GHRSS discoveries from the FFA search lie in narrow duty cycle ranges beyond the limit of the existing population. The implementation of FFA search in the GHRSS survey and other pulsar surveys is expected to recover the missing population of long period and short duty cycle pulsars.


title: Libraries, Integrations and Hubs for Decentralized AI using IPFS

abstract: AI requires heavy amounts of storage and compute. As a result, AI developers are regular users of centralised cloud services such as AWS, GCP and Azure, compute environments such as Jupyter and Colab notebooks, and AI Hubs such as HuggingFace and ActiveLoop. There services are associated with certain benefits and limitations that stem from the underlying infrastructure and governance systems with which they are built. These limitations include high costs, lack of monetization and reward, lack of control and difficulty of reproducibility. At the same time, there are few libraries that allow data scientists to interact with decentralised storage in the language that data scientists are used to, and few hubs where they can discover and interact with AI assets. In this report, we explore the potential of decentralized technologies - such as Web3 wallets, peer-to-peer marketplaces, decentralized storage (IPFS and Filecoin) and compute, and DAOs - to address some of the above limitations. We showcase some of the libraries and integrations that we have built to tackle these issues, as well as a proof of concept of a decentralized AI Hub app, that all use IPFS as a core infrastructural component.


title: Bundles of Weyl structures and invariant calculus for parabolic geometries

abstract: For more than hundred years, various concepts were developed to understand the fields of geometric objects and invariant differential operators between them for conformal Riemannian and projective geometries. More recently, several general tools were presented for the entire class of parabolic geometries, i.e., the Cartan geometries modelled on homogeneous spaces $G/P$ with $P$ a parabolic subgroup in a semi-simple Lie group $G$. Similarly to conformal Riemannian and projective structures, all these geometries determine a class of distinguished affine connections, which carry an affine structure modelled on differential 1-forms $\Upsilon$. They correspond to reductions of $P$ to its reductive Levi factor, and they are called the Weyl structures similarly to the conformal case. The standard definition of differential invariants in this setting is as affine invariants of these connections, which do not depend on the choice within the class. In this article, we describe a universal calculus which provides an important first step to determine such invariants. We present a natural procedure how to construct all affine invariants of Weyl connections, which depend only tensorially on the deformations $\Upsilon$.


abstract: Common methods to achieve photon number resolution rely on fast on-off single-photon detectors in conjunction with temporal or spatial mode multiplexing. Yet, these methods suffer from an inherent trade-off between the efficiency of photon number discrimination and photon detection rate. Here, we introduce a method of photon number resolving detection that overcomes these limitations by replacing mode multiplexing with coherent absorption of a single optical mode in a distributed detector array. Distributed coherent absorption ensures complete and uniform absorption of light among the constituent detectors, enabling fast and efficient photon number resolution. As a proof-of-concept, we consider the case of a distributed array of superconducting nanowire single-photon detectors with realistic parameters and show that deterministic absorption and arbitrarily high photon number discrimination efficiency can be achieved by increasing the number of detectors in the array. Photon number resolution without optical mode multiplication provides a simple yet effective method to discriminate an arbitrary number of photons in large arrays of on-off detectors or in smaller arrays of mode multiplexed detectors.


title: Biological free energy transduction is an Achilles heel of mean-field transport theory

abstract: Studies of nanoscale biological transport often use a mean-field approximation that is exact only when the system is at equilibrium and there are no interactions between particles on different sites in the network. We explore the limitations of this approximation to describe many-particle transport in the context of enzyme function and biological transport networks. Our focus is on three bioenergetic networks: a linear electron transfer chain (as found in bacterial nanowires), a redox-coupled proton pump (as in complex IV of respiration), and a near reversible electron bifurcation network (as in complex III of respiration and other recently discovered structures). Away from equilibrium and with typical site-site interactions, we find that the mean-field approximation adequately describes linear transport chains. However, the mean-field approximation fails catastrophically to describe energy-transducing systems, as in the redox coupled proton pump and reversible electron bifurcation reactions. The mean-field approximation fails to capture the essential correlations that are needed to prevent slippage events and to produce efficient energy transduction.


title: A note on the equivalence between the conditional uncorrelation and the independence of random variables

abstract: It is well known that while the independence of random variables implies zero correlation, the opposite is not true. Namely, uncorrelated random variables are not necessarily independent. In this note we show that the implication could be reversed if we consider the localised version of the correlation coefficient. More specifically, we show that if random variables are conditionally (locally) uncorrelated for any quantile conditioning sets, then they are independent. For simplicity, we focus on the absolutely continuous case. Also, we illustrate potential usefulness of the stated result using two simple examples.


title: Auxo: Efficient Federated Learning via Scalable Client Clustering

abstract: Federated learning (FL) is an emerging machine learning (ML) paradigm that enables heterogeneous edge devices to collaboratively train ML models without revealing their raw data to a logically centralized server. However, beyond the heterogeneous device capacity, FL participants often exhibit differences in their data distributions, which are not independent and identically distributed (Non-IID). Many existing works present point solutions to address issues like slow convergence, low final accuracy, and bias in FL, all stemming from client heterogeneity. In this paper, we explore an additional layer of complexity to mitigate such heterogeneity by grouping clients with statistically similar data distributions (cohorts). We propose Auxo to gradually identify such cohorts in large-scale, low-availability, and resource-constrained FL populations. Auxo then adaptively determines how to train cohort-specific models in order to achieve better model performance and ensure resource efficiency. Our extensive evaluations show that, by identifying cohorts with smaller heterogeneity and performing efficient cohort-based training, Auxo boosts various existing FL solutions in terms of final accuracy (2.1% - 8.2%), convergence time (up to 2.2x), and model bias (4.8% - 53.8%).


title: Improved Support Recovery in Universal One-bit Compressed Sensing

abstract: One-bit compressed sensing (1bCS) is an extremely quantized signal acquisition method that has been proposed and studied rigorously in the past decade. In 1bCS, linear samples of a high dimensional signal are quantized to only one bit per sample (sign of the measurement). Assuming the original signal vector to be sparse, existing results in 1bCS either aim to find the support of the vector, or approximate the signal allowing a small error. The focus of this paper is support recovery, which often also computationally facilitate approximate signal recovery. A {\em universal} measurement matrix for 1bCS refers to one set of measurements that work for all sparse signals. With universality, it is known that $\tilde{\Theta}(k^2)$ 1bCS measurements are necessary and sufficient for support recovery (where $k$ denotes the sparsity). To improve the dependence on sparsity from quadratic to linear, in this work we propose approximate support recovery (allowing $\epsilon>0$ proportion of errors), and superset recovery (allowing $\epsilon$ proportion of false positives). We show that the first type of recovery is possible with $\tilde{O}(k/\epsilon)$ measurements, while the later type of recovery, more challenging, is possible with $\tilde{O}(\max\{k/\epsilon,k^{3/2}\})$ measurements. We also show that in both cases $\Omega(k/\epsilon)$ measurements would be necessary for universal recovery. Improved results are possible if we consider universal recovery within a restricted class of signals, such as rational signals, or signals with bounded dynamic range. In both cases superset recovery is possible with only $\tilde{O}(k/\epsilon)$ measurements. Other results on universal but approximate support recovery are also provided in this paper. All of our main recovery algorithms are simple and polynomial-time.


title: Perturbation Analysis of Neural Collapse

abstract: Training deep neural networks for classification often includes minimizing the training loss beyond the zero training error point. In this phase of training, a "neural collapse" behavior has been observed: the variability of features (outputs of the penultimate layer) of within-class samples decreases and the mean features of different classes approach a certain tight frame structure. Recent works analyze this behavior via idealized unconstrained features models where all the minimizers exhibit exact collapse. However, with practical networks and datasets, the features typically do not reach exact collapse, e.g., because deep layers cannot arbitrarily modify intermediate features that are far from being collapsed. In this paper, we propose a richer model that can capture this phenomenon by forcing the features to stay in the vicinity of a predefined features matrix (e.g., intermediate features). We explore the model in the small vicinity case via perturbation analysis and establish results that cannot be obtained by the previously studied models. For example, we prove reduction in the within-class variability of the optimized features compared to the predefined input features (via analyzing gradient flow on the "central-path" with minimal assumptions), analyze the minimizers in the near-collapse regime, and provide insights on the effect of regularization hyperparameters on the closeness to collapse. We support our theory with experiments in practical deep learning settings.


title: Learning Dependencies of Discrete Speech Representations with Neural Hidden Markov Models

abstract: While discrete latent variable models have had great success in self-supervised learning, most models assume that frames are independent. Due to the segmental nature of phonemes in speech perception, modeling dependencies among latent variables at the frame level can potentially improve the learned representations on phonetic-related tasks. In this work, we assume Markovian dependencies among latent variables, and propose to learn speech representations with neural hidden Markov models. Our general framework allows us to compare to self-supervised models that assume independence, while keeping the number of parameters fixed. The added dependencies improve the accessibility of phonetic information, phonetic segmentation, and the cluster purity of phones, showcasing the benefit of the assumed dependencies.


title: Alya towards Exascale: Algorithmic Scalability using PSCToolkit

abstract: In this paper, we describe an upgrade of the Alya code with up-to-date parallel linear solvers capable of achieving reliability, efficiency and scalability in the computation of the pressure field at each time step of the numerical procedure for solving a Large Eddy Simulation formulation of the incompressible Navier-Stokes equations. We developed a software module in Alya's kernel to interface the libraries included in the current version of PSCToolkit, a framework for the iterative solution of sparse linear systems on parallel distributed-memory computers by Krylov methods coupled to Algebraic MultiGrid preconditioners. The Toolkit has undergone various extensions within the EoCoE-II project with the primary goal of facing the exascale challenge. Results on a realistic benchmark for airflow simulations in wind farm applications show that the PSCToolkit solvers significantly outperform the original versions of the Conjugate Gradient method available in the Alya's kernel in terms of scalability and parallel efficiency and represent a very promising software layer to move the Alya code towards exascale.


title: Circular Costas maps: a multidimensional analog of circular Costas sequences

abstract: A unifying theoretical framework is presented, in which the connections among Costas sequences, circular Costas sequences, Costas polynomials, the shifting property, and Welch sequences are extended to the multidimensional context. Several conjectures on multidimensional periodic Costas arrays by J. Ortiz-Ubarri et al. are proved. Furthermore, a conjecture on Costas polynomials over extension fields presented by Muratovic-Ribic et al. is showed to be a multidimensional extension of a conjecture by Golomb and Moreno on circular Costas sequences. A weaker version of said conjecture is proved by considering a multidimensional extension of the shifting Costas property defined by O. Moreno.


title: Global Optimization of Energy Efficiency in IRS-Aided Communication Systems via Robust IRS-Element Activation

abstract: In this paper, we study an intelligent reflecting surface (IRS) assisted communication system with single-antenna transmitter and receiver, under imperfect channel state information (CSI). More specifically, we deal with the robust selection of binary (on/off) states of the IRS elements in order to maximize the worst-case energy efficiency (EE), given a bounded CSI uncertainty, while satisfying a minimum signal-to-noise ratio (SNR). The IRS phase shifts are adjusted so as to maximize the ideal SNR (i.e., without CSI error), based only on the estimated channels. First, we derive a closed-form expression of the worst-case SNR, and then formulate the robust (discrete) optimization problem. Moreover, we design and analyze a dynamic programming (DP) algorithm that is theoretically guaranteed to achieve the global maximum with polynomial complexity $O(L \log L)$, where $L$ is the number of IRS elements. Finally, numerical simulations confirm the theoretical results. In particular, the proposed algorithm shows identical performance with the exhaustive search, and significantly outperforms a baseline scheme, namely, the activation of all IRS elements.


title: BERT Meets CTC: New Formulation of End-to-End Speech Recognition with Pre-trained Masked Language Model

abstract: This paper presents BERT-CTC, a novel formulation of end-to-end speech recognition that adapts BERT for connectionist temporal classification (CTC). Our formulation relaxes the conditional independence assumptions used in conventional CTC and incorporates linguistic knowledge through the explicit output dependency obtained by BERT contextual embedding. BERT-CTC attends to the full contexts of the input and hypothesized output sequences via the self-attention mechanism. This mechanism encourages a model to learn inner/inter-dependencies between the audio and token representations while maintaining CTC's training efficiency. During inference, BERT-CTC combines a mask-predict algorithm with CTC decoding, which iteratively refines an output sequence. The experimental results reveal that BERT-CTC improves over conventional approaches across variations in speaking styles and languages. Finally, we show that the semantic representations in BERT-CTC are beneficial towards downstream spoken language understanding tasks.


title: Aggregating regular norms

abstract: The subject of this paper is regularity-preserving aggregation of regular norms on finite-dimensional linear spaces. Regular norms were introduced in [5] and are closely related to ``type 2'' spaces [9, Chapter 9] playing important role in 1) high-dimensional convex geometry and probability in Banach spaces [0.9.12.13.15], and in 2) design of proximal first-order algorithms for large-scale convex optimization with dimension-independent, or nearly so, complexity. Regularity, with moderate parameters, of a norm makes applicable, in a dimension-independent fashion, numerous geometric, probabilistic, and optimization-related results, which motivates our interest in aggregating regular norms with controlled (and moderate) inflation of regularity parameters.


title: Construction of Global Solutions to the Linearized Field Equations for Causal Variational Principles

abstract: We give a novel construction of global solutions to the linearized field equations for causal variational principles. The method is to glue together local solutions supported in lens-shaped regions. As applications, causal Green's operators and cone structures are introduced.


title: On the average order of a finite group

abstract: Let $o(G)$ be the average order of a finite group $G$. We show that if $o(G)<c$, where $c\in \lbrace \frac{13}{6}, \frac{11}{4}\rbrace$, then $G$ is an elementary abelian 2-group or a solvable group, respectively. Also, we prove that the set containing the average orders of all finite groups is not dense in $[a, \infty)$, for all $a\in [0, \frac{13}{6}]$. We also outline some results related to the integer values of the average order. Since group element orders is a popular research topic, we pose some open problems concerning the average order of a finite group throughout the paper.


title: IRS-User Association in IRS-Aided MISO Wireless Networks: Convex Optimization and Machine Learning Approaches

abstract: This paper concentrates on the problem of associating an intelligent reflecting surface (IRS) to multiple users in a multiple-input single-output (MISO) downlink wireless communication network. The main objective of the paper is to maximize the sum-rate of all users by solving the joint optimization problem of the IRS-user association, IRS reflection, and BS beamforming, formulated as a non-convex mixed-integer optimization problem. The variable separation and relaxation are used to transform the problem into three convex sub-problems, which are alternatively solved through the convex optimization (CO) method. The major drawback of the proposed CO-based algorithm is high computational complexity. Thus, we make use of machine learning (ML) to tackle this problem. To this end, first, we convert the optimization problem into a regression problem. Then, we solve it with feed-forward neural networks (FNNs), trained by CO-based generated data. Simulation results show that the proposed ML-based algorithm has a performance equivalent to the CO-based algorithm, but with less computation complexity due to its offline training procedure.


title: Advancing Algorithm to Scale and Accurately Solve Quantum Poisson Equation on Near-term Quantum Hardware

abstract: The Poisson equation has many applications across the broad areas of science and engineering. Most quantum algorithms for the Poisson solver presented so far either suffer from lack of accuracy and/or are limited to very small sizes of the problem, and thus have no practical usage. Here we present an advanced quantum algorithm for solving the Poisson equation with high accuracy and dynamically tunable problem size. After converting the Poisson equation to a linear system through the finite difference method, we adopt the HHL algorithm as the basic framework. Particularly, in this work we present an advanced circuit that ensures the accuracy of the solution by implementing non-truncated eigenvalues through eigenvalue amplification, as well as by increasing the accuracy of the controlled rotation angular coefficients, which are the critical factors in the HHL algorithm. Consequently, we are able to drastically reduce the relative error in the solution while achieving higher success probability as the amplification level is increased. We show that our algorithm not only increases the accuracy of the solutions but also composes more practical and scalable circuits by dynamically controlling problem size in NISQ devices. We present both simulated and experimental results and discuss the sources of errors. Finally, we conclude that though overall results on the existing NISQ hardware are dominated by the error in the CNOT gates, this work opens a path to realizing a multidimensional Poisson solver on near-term quantum hardware.


title: Electron density variations in the interstellar medium and the average frequency profile of a scintle from pulsar scintillation spectra

abstract: We observed the scintillation pattern of nine bright pulsars at 324 MHz and three at 1.68 GHz and analyzed the wavenumber spectrum which is related to electron density variations of the plasma turbulence of the interstellar medium. For all pulsars the frequency section of the autocorrelation function of the dynamic spectra to at least 45\% of the maximum corresponds to predictions of scattering theories with a range of power-law exponents of the wavenumber spectrum of $3.56 \leq \alpha \leq 3.97$ with errors $\leq 0.05$ and a mean with standard deviation of $3.76\pm0.13$. The range includes $\alpha=3.67$ for the Kolmogorov spectrum. Similar results although with larger errors were found from the Fourier transform of the autocorrelation functions down to $\sim 10^{-3}$ of the maximum. No clear case of a distinction between thin-screen and extended-medium scattering models was found. The average frequency profile of the scintles can be characterized for steep wavenumber spectra with $\alpha\lesssim4$ by a cusp with a somewhat rounded peak. For flatter spectra, down to at least $\alpha\sim 3.56$ the cusp with its peak becomes more pronounced and its decay steepens. We discuss our findings in the context of scattering characteristics of the interstellar medium.


title: A Comparative Study of Graph Neural Networks for Shape Classification in Neuroimaging

abstract: Graph neural networks have emerged as a promising approach for the analysis of non-Euclidean data such as meshes. In medical imaging, mesh-like data plays an important role for modelling anatomical structures, and shape classification can be used in computer aided diagnosis and disease detection. However, with a plethora of options, the best architectural choices for medical shape analysis using GNNs remain unclear. We conduct a comparative analysis to provide practitioners with an overview of the current state-of-the-art in geometric deep learning for shape classification in neuroimaging. Using biological sex classification as a proof-of-concept task, we find that using FPFH as node features substantially improves GNN performance and generalisation to out-of-distribution data; we compare the performance of three alternative convolutional layers; and we reinforce the importance of data augmentation for graph based learning. We then confirm these results hold for a clinically relevant task, using the classification of Alzheimer's disease.


title: Geometrical aspects of Amplitudes and Correlators in N=4 SYM

abstract: This thesis describes progresses made by the author and collaborators in the positive geometry description of superamplitudes and supercorrelators in planar N = 4 SYM.


title: Tight Heffter arrays from finite fields

abstract: After extending the classic notion of a tight Heffter array H$(m,n)$ to any group of order $2mn+1$, we give direct constructions for elementary abelian tight Heffter arrays, hence in particular for prime tight Heffter arrays. If $q=2mn+1$ is a prime power, we say that an elementary abelian H$(m,n)$ is ``over $\mathbb{F}_q$" since, for its construction, we exploit both the additive and multiplicative structure of the field of order $q$. We show that in many cases a direct construction of an H$(m,n)$ over $\mathbb{F}_q$, say $A$, can be obtained very easily by imposing that $A$ has rank 1 and, possibly, a rich group of {\it multipliers}, that are elements $u$ of $\mathbb{F}_q$ such that $u A=A$ up to a permutation of rows and columns. An H$(m,n)$ over $\mathbb{F}_q$ will be said {\it optimal} if the order of its group of multipliers is the least common multiple of the odd parts of $m$ and $n$, since this is the maximum possible order for it. The main result is an explicit construction of a rank-one H$(m,n)$ -- reaching almost always the optimality -- for all admissible pairs $(m,n)$ for which there exist two distinct odd primes $p$, $p'$ dividing $m$ and $n$, respectively.


title: Electrostatic system with divergence-free Bach tensor and non-null cosmological constant

abstract: We prove that three-dimensional electrostatic manifolds with divergence-free Bach tensor are locally conformally flat, provide that the electric field and the gradient of the lapse function are linearly dependent. Consequently, a three-dimensional electrostatic manifold admits a local warped product structure with a one-dimensional base and a constant curvature surface fiber.


title: Semantic-SuPer: A Semantic-aware Surgical Perception Framework for Endoscopic Tissue Identification, Reconstruction, and Tracking

abstract: Accurate and robust tracking and reconstruction of the surgical scene is a critical enabling technology toward autonomous robotic surgery. Existing algorithms for 3D perception in surgery mainly rely on geometric information, while we propose to also leverage semantic information inferred from the endoscopic video using image segmentation algorithms. In this paper, we present a novel, comprehensive surgical perception framework, Semantic-SuPer, that integrates geometric and semantic information to facilitate data association, 3D reconstruction, and tracking of endoscopic scenes, benefiting downstream tasks like surgical navigation. The proposed framework is demonstrated on challenging endoscopic data with deforming tissue, showing its advantages over our baseline and several other state-of the-art approaches. Our code and dataset are available at https://github.com/ucsdarclab/Python-SuPer.


title: Complexity Synchronization

abstract: The observational ubiquity of inverse power law spectra (IPL) in complex phenomena entails theory for dynamic fractal phenomena capturing their fractal dimension, dynamics, and statistics. These and other properties are consequences of the complexity resulting from nonlinear dynamic networks collectively summarized for biomedical phenomena as the Network Effect (NE) or focused more narrowly as Network Physiology. Herein we address the measurable consequences of the NE on time series generated by different parts of the brain, heart, and lung organ networks, which are directly related to their inter-network and intra-network interactions. Moreover, these same physiologic organ networks have been shown to generate crucial event (CE) time series, and herein are shown, using modified diffusion entropy analysis (MDEA), to have scaling indices with quasiperiodic changes in complexity, as measured by scaling indices, over time. Such time series are generated by different parts of the brain, heart, and lung organ networks, and the results do not depend on the underlying coherence properties of the associated time series but demonstrate a generalized synchronization of complexity. This high order synchrony among the scaling indices of EEG (brain), ECG (heart), and respiratory time series is governed by the quantitative interdependence of the multifractal behavior of the various physiological organs' network dynamics. This consequence of the NE opens the door for an entirely general characterization of the dynamics of complex networks in terms of complexity synchronization (CS) independently of the scientific, engineering, or technological context.


title: Path-integral approaches to strongly-coupled quantum many-body systems

abstract: The core of this thesis is the path-integral formulation of quantum field theory and its ability to describe strongly-coupled quantum many-body systems of finite size. Collective behaviors can be efficiently described in such systems through the implementation of spontaneous symmetry breaking (SSB) in mean-field approaches. However, as the thermodynamic limit does not make sense in finite-size systems, the latter can not exhibit any SSB and the symmetries which are broken down at the mean-field level must therefore be restored. The efficiency of theoretical approaches in the treatment of finite-size quantum systems can therefore be studied via their ability to restore spontaneously broken symmetries. In this thesis, a zero-dimensional $O(N)$ model is taken as a theoretical laboratory to perform such an investigation with many state-of-the-art path-integral techniques: perturbation theory combined with various resummation methods (Pad\'e-Borel, Borel-hypergeometric, conformal mapping), enhanced versions of perturbation theory (transseries derived via Lefschetz thimbles, optimized perturbation theory), self-consistent perturbation theory based on effective actions (auxiliary field loop expansion (LOAF), Cornwall-Jackiw-Tomboulis (CJT) formalism, 4PPI effective action, ...), functional renormalization group (FRG) techniques (FRG based on the Wetterich equation, DFT-FRG, 2PI-FRG). Connections between these different techniques are also emphasized. In addition, the path-integral formalism provides us with the possibility to introduce collective degrees of freedom in an exact fashion via Hubbard-Stratonovich transformations: the effect of such transformations on the aforementioned methods is also examined in detail.


title: Knitting Knots & the Framing Anomaly

abstract: We study the twisting fault emerging in circular knitting and its relation to the mathematical concepts of framing curves and the Gauss linking integral. We create three knitted bands with framing zero, one, and negative two, and use three different techniques to compute the framing using the Gauss linking integral. We also briefly mention the connection to in Chern-Simons gauge theory.


title: Curse of Scale-Freeness: Intractability of Large-Scale Combinatorial Optimization with Multi-Start Methods

abstract: This paper investigates the intractability of large-scale combinatorial optimization with multi-start methods. For the theoretical performance analysis, we focus on the random multi-start (RMS) method, one of the representative multi-start methods including the RMS local search and the greedy randomized adaptive search procedure (GRASP). Our main theoretical contribution is to derive two power-law formulas using extreme value theory. One is for the expected improvement rate (EIR) of the best empirical objective value (EOV), and the other is for the expected relative gap (ERG) of the best EOV to the supremum of empirical objective values. Notably, the ERG has scale-freeness as a function of the number of iterations. Thus, the ``half-life" of the ERG is eventually proportional to the number of iterations completed by an RMS algorithm. This result can be understood as the curse of scale-freeness: a Zeno's paradox-like phenomenon of ``trying to get to the goal pushes it far away," Through numerical experiments, we observe that applying several RMS algorithms to traveling salesman problems is subject to the curse of scale-freeness. Furthermore, we show that overcoming the curse of scale-freeness requires the development of an algorithm with exponentially accelerated performance compared to the RMS method.


title: Monitoring the Dynamic Networks of Stock Returns

abstract: In this paper, we study the connection between the companies in the Swedish capital market. We consider 28 companies included in the determination of the market index OMX30. The network structure of the market is constructed using different methods to determine the distance between the companies. We use hierarchical clustering methods to find the relation among the companies in each window. Next, we obtain one-dimensional time series of the distances between the clustering trees that reflect the changes in the relationship between the companies in the market over time. The method of statistical process control, namely the Shewhart control chart, is applied to those time series to detect abnormal changes in the financial market.


title: An Analytical Model for Stepwise Adiabatic Driver Energy Consumption

abstract: This paper presents a complete closed-form analytical model for determining the per-cycle energy consumption of stepwise adiabatic drivers used for driving a capacitive load such as a power FET gate. The model takes into account the number of steps used, the stepwise driver tank capacitance, the load capacitance, and the stepwise driver switch resistance and on-time. Model accuracy is compared to that of simulation and models from previous work.


title: Diffusive limits of the steady state radiative heat transfer system: Boundary layers

abstract: In this paper, we study the diffusive limit of the steady state radiative heat transfer system for non-homogeneous Dirichlet boundary conditions in a bounded domain with flat boundaries. A composite approximate solution is constructed using asymptotic analysis taking into account of the boundary layers. The convergence to the approximate solution in the diffusive limit is proved using a Banach fixed point theorem. The major difficulty lies on the nonlinear coupling between elliptic and kinetic transport equations. To overcome this problem, a spectral assumption ensuring the linear stability of the boundary layers is proposed. Moreover, a combined $L^2$-$L^\infty$ estimate and the Banach fixed point theorem are used to obtain the convergence proof. This results extend our previous work \cite{ghattassi2020diffusive} for the well-prepared boundary data case to the ill-prepared case when boundary layer exists.


title: Robust Distributed Learning Against Both Distributional Shifts and Byzantine Attacks

abstract: In distributed learning systems, robustness issues may arise from two sources. On one hand, due to distributional shifts between training data and test data, the trained model could exhibit poor out-of-sample performance. On the other hand, a portion of working nodes might be subject to byzantine attacks which could invalidate the learning result. Existing works mostly deal with these two issues separately. In this paper, we propose a new algorithm that equips distributed learning with robustness measures against both distributional shifts and byzantine attacks. Our algorithm is built on recent advances in distributionally robust optimization as well as norm-based screening (NBS), a robust aggregation scheme against byzantine attacks. We provide convergence proofs in three cases of the learning model being nonconvex, convex, and strongly convex for the proposed algorithm, shedding light on its convergence behaviors and endurability against byzantine attacks. In particular, we deduce that any algorithm employing NBS (including ours) cannot converge when the percentage of byzantine nodes is 1/3 or higher, instead of 1/2, which is the common belief in current literature. The experimental results demonstrate the effectiveness of our algorithm against both robustness issues. To the best of our knowledge, this is the first work to address distributional shifts and byzantine attacks simultaneously.