title: Federated Learning in Satellite Constellations

abstract: Federated learning (FL) has recently emerged as a distributed machine learning paradigm for systems with limited and intermittent connectivity. This paper presents the new context brought to FL by satellite constellations, where the connectivity patterns are significantly different from the ones observed in conventional terrestrial FL. The focus is on large constellations in low Earth orbit (LEO), where each satellites participates in a data-driven FL task using a locally stored dataset. This scenario is motivated by the trend towards mega constellations of interconnected small satellites in LEO and the integration of artificial intelligence in satellites. We propose a classification of satellite FL based on the communication capabilities of the satellites, the constellation design, and the location of the parameter server. A comprehensive overview of the current state-of-the-art in this field is provided and the unique challenges and opportunities of satellite FL are discussed. Finally, we outline several open research directions for FL in satellite constellations and present some future perspectives on this topic.


title: Content Distribution based on Joint V2I and V2V Scheduling in mmWave Vehicular Networks

abstract: With the explosive growth of vehicle applications, vehicular networks based on millimeter wave (mmWave) bands have attracted interests from both academia and industry. mmWave communications are able to utilize the huge available bandwidth to provide multiple Gbps transmission rates among vehicles. In this paper, we address the content distribution scheduling problem in mmWave vehicular networks. It has been challenging for all vehicles in the same network to complete content downloading due to the limited communication resources of roadside units (RSUs) and the high mobility of vehicles. We propose a joint vehicle-to-infrastructure (V2I) and vehicle-tovehicle (V2V) scheduling scheme to minimize the total number of content distribution time slots from a global optimization perspective. In the V2I phase, the RSU serially transmits integrity content to vehicles, which are selected according to the vehicular network topology and transmission scheduling scheme. In the V2V phase, full-duplex communications and concurrent transmissions are exploited to achieve content sharing between vehicles and improve transmission efficiency. Performance evaluations demonstrate that our proposed scheme reduces the number of time slots and significantly improves system throughput when compared with other schemes, especially under large-size file transfers and a large number of vehicles.


title: Label-Efficient Online Continual Object Detection in Streaming Video

abstract: Humans can watch a continuous video stream and effortlessly perform continual acquisition and transfer of new knowledge with minimal supervision yet retaining previously learnt experiences. In contrast, existing continual learning (CL) methods require fully annotated labels to effectively learn from individual frames in a video stream. Here, we examine a more realistic and challenging problem$\unicode{x2014}$Label-Efficient Online Continual Object Detection (LEOCOD) in streaming video. We propose a plug-and-play module, Efficient-CLS, that can be easily inserted into and improve existing continual learners for object detection in video streams with reduced data annotation costs and model retraining time. We show that our method has achieved significant improvement with minimal forgetting across all supervision levels on two challenging CL benchmarks for streaming real-world videos. Remarkably, with only 25% annotated video frames, our method still outperforms the base CL learners, which are trained with 100% annotations on all video frames. The data and source code will be publicly available at https://github.com/showlab/Efficient-CLS.


title: Digital Twin for Networking: A Data-driven Performance Modeling Perspective

abstract: Emerging technologies and applications make the network unprecedentedly complex and heterogeneous, leading physical network practices to be costly and risky. The digital twin network (DTN) can ease these burdens by virtually enabling users to understand how performance changes accordingly with modifications. For this "What-if" performance evaluation, conventional simulation and analytical approaches are inefficient, inaccurate, and inflexible, and we argue that data-driven methods are most promising. In this article, we identify three requirements (fidelity, efficiency, and flexibility) for performance evaluation. Then we present a comparison of selected data-driven methods and investigate their potential trends in data, models, and applications. Although extensive applications have been enabled, there are still significant conflicts between models' capacities to handle diversified inputs and limited data collected from the production network. We further illustrate the opportunities for data collection, model construction, and application prospects. This survey aims to provide a reference for performance evaluation while also facilitating future DTN research.


title: MaskOCR: Text Recognition with Masked Encoder-Decoder Pretraining

abstract: Text images contain both visual and linguistic information. However, existing pre-training techniques for text recognition mainly focus on either visual representation learning or linguistic knowledge learning. In this paper, we propose a novel approach MaskOCR to unify vision and language pre-training in the classical encoder-decoder recognition framework. We adopt the masked image modeling approach to pre-train the feature encoder using a large set of unlabeled real text images, which allows us to learn strong visual representations. In contrast to introducing linguistic knowledge with an additional language model, we directly pre-train the sequence decoder. Specifically, we transform text data into synthesized text images to unify the data modalities of vision and language, and enhance the language modeling capability of the sequence decoder using a proposed masked image-language modeling scheme. Significantly, the encoder is frozen during the pre-training phase of the sequence decoder. Experimental results demonstrate that our proposed method achieves superior performance on benchmark datasets, including Chinese and English text images.


title: A Spectral Method for Depth-Separated Solution of a Wavenumber Integration Model in Horizontally Stratified Fluid Acoustic Waveguides

abstract: The wavenumber integration model is considered to be the most accurate algorithm for arbitrary horizontally stratified media in computational ocean acoustics. In contrast to the normal mode approach, it considers not only the discrete wavenumber spectrum but also the continuous spectrum components, eliminating errors in the model approximation for horizontally stratified media. Traditionally, analytical and semianalytical methods have been used to solve the depth-separated wave equation in the wavenumber integration method, and numerical solutions have generally focused on the finite difference method and the finite element method. In this paper, an algorithm for solving the depth equation using the Chebyshev--Tau spectral method combined with a domain decomposition strategy is proposed, and a numerical program named WISpec is developed accordingly. The proposed algorithm can simulate not only the sound field excited by a point source but also the sound field excited by an infinite line source. The key idea of the algorithm is to first discretize the depth equations for each layer via the Chebyshev--Tau spectral method and then solve the equations for each layer simultaneously by incorporating boundary and interface conditions. Several representative numerical experiments are devised to test the accuracy and speed of WISpec. The high consistency of the results of different software programs running under the same configuration proves that the numerical algorithm proposed in this paper is accurate, reliable and numerically stable.


title: High-Order Large-Eddy Simulations of a Wind Turbine in Ducted and Open-Rotor Configurations

abstract: High-order large-eddy simulations are performed to study the performance and flow field of a ducted wind turbine operating at different tip speed ratios. To evaluate the effects of the duct, simulations with the same tip speed ratios are also performed on the corresponding open-rotor turbine. It is found that the ducted turbine consistently obtains higher power outputs than the open-rotor counterpart, and the duct itself enhances flow turbulence and blade trailing-edge vortices but weakens tip and hub vortices. Flow bifurcation is observed at the largest tip speed ratio and is identified to be caused by blade blockage effects. Comparative simulations are also performed on both turbines under different yaw angles. It is noticed that the ducted configuration is insensitive to small yaw angles and maintains higher power outputs than the open-rotor configuration at all yaw angles. Moreover, it is observed that the wakes of both configurations recover more quickly as the yaw angle increases.


title: Contextual Bandits with Knapsacks for a Conversion Model

abstract: We consider contextual bandits with knapsacks, with an underlying structure between rewards generated and cost vectors suffered. We do so motivated by sales with commercial discounts. At each round, given the stochastic i.i.d.\ context $\mathbf{x}_t$ and the arm picked $a_t$ (corresponding, e.g., to a discount level), a customer conversion may be obtained, in which case a reward $r(a,\mathbf{x}_t)$ is gained and vector costs $c(a_t,\mathbf{x}_t)$ are suffered (corresponding, e.g., to losses of earnings). Otherwise, in the absence of a conversion, the reward and costs are null. The reward and costs achieved are thus coupled through the binary variable measuring conversion or the absence thereof. This underlying structure between rewards and costs is different from the linear structures considered by Agrawal and Devanur [2016] (but we show that the techniques introduced in the present article may also be applied to the case of these linear structures). The adaptive policies exhibited solve at each round a linear program based on upper-confidence estimates of the probabilities of conversion given $a$ and $\mathbf{x}$. This kind of policy is most natural and achieves a regret bound of the typical order (OPT/$B$) $\sqrt{T}$, where $B$ is the total budget allowed, OPT is the optimal expected reward achievable by a static policy, and $T$ is the number of rounds.


title: The algebraic and geometric classification of Zinbiel algebras

abstract: This paper is devoted to the complete algebraic and geometric classification of complex $5$-dimensional Zinbiel algebras. In particular, we proved that the variety of complex $5$-dimensional Zinbiel algebras has dimension $24$, it is defined by $16$ irreducible components and it has $11$ rigid algebras.


title: Model Generation with Provable Coverability for Offline Reinforcement Learning

abstract: Model-based offline optimization with dynamics-aware policy provides a new perspective for policy learning and out-of-distribution generalization, where the learned policy could adapt to different dynamics enumerated at the training stage. But due to the limitation under the offline setting, the learned model could not mimic real dynamics well enough to support reliable out-of-distribution exploration, which still hinders policy to generalize well. To narrow the gap, previous works roughly ensemble randomly initialized models to better approximate the real dynamics. However, such practice is costly and inefficient, and provides no guarantee on how well the real dynamics could be approximated by the learned models, which we name coverability in this paper. We actively address this issue by generating models with provable ability to cover real dynamics in an efficient and controllable way. To that end, we design a distance metric for dynamic models based on the occupancy of policies under the dynamics, and propose an algorithm to generate models optimizing their coverage for the real dynamics. We give a theoretical analysis on the model generation process and proves that our algorithm could provide enhanced coverability. As a downstream task, we train a dynamics-aware policy with minor or no conservative penalty, and experiments demonstrate that our algorithm outperforms prior offline methods on existing offline RL benchmarks. We also discover that policies learned by our method have better zero-shot transfer performance, implying their better generalization.


title: Temporal Characterization of VR Traffic for Network Slicing Requirement Definition

abstract: Over the past few years, the concept of VR has attracted increasing interest thanks to its extensive industrial and commercial applications. Currently, the 3D models of the virtual scenes are generally stored in the VR visor itself, which operates as a standalone device. However, applications that entail multi-party interactions will likely require the scene to be processed by an external server and then streamed to the visors. However, the stringent Quality of Service (QoS) constraints imposed by VR's interactive nature require Network Slicing (NS) solutions, for which profiling the traffic generated by the VR application is crucial. To this end, we collected more than 4 hours of traces in a real setup and analyzed their temporal correlation. More specifically, we focused on the CBR encoding mode, which should generate more predictable traffic streams. From the collected data, we then distilled two prediction models for future frame size, which can be instrumental in the design of dynamic resource allocation algorithms. Our results show that even the state-of-the-art H.264 CBR mode can have significant fluctuations, which can impact the NS optimization. We then exploited the proposed models to dynamically determine the Service Level Agreement (SLA) parameters in an NS scenario, providing service with the required QoS while minimizing resource usage.


title: The $\mathrm{CMO}$-Dirichlet problem for elliptic systems in the upper half-space

abstract: We prove that for any second-order, homogeneous, $N \times N$ elliptic system $L$ with constant complex coefficients in $\mathbb{R}^n$, the Dirichlet problem in $\mathbb{R}^n_+$ with boundary data in $\mathrm{CMO}(\mathbb{R}^{n-1}, \mathbb{C}^N)$ is well-posed under the assumption that $d\mu(x', t) := |\nabla u(x)|^2\, t \, dx' dt$ is a strong vanishing Carleson measure in $\mathbb{R}^n_+$ in some sense. This solves an open question posed by Martell et al. The proof relies on a quantitative Fatou-type theorem, which not only guarantees the existence of the pointwise nontangential boundary trace for smooth null-solutions satisfying a strong vanishing Carleson measure condition, but also includes a Poisson integral representation formula of solutions along with a characterization of $\mathrm{CMO}(\mathbb{R}^{n-1}, \mathbb{C}^N)$ in terms of the traces of solutions of elliptic systems. Moreover, we are able to establish the well-posedness of the Dirichlet problem in $\mathbb{R}^n_+$ for a system $L$ as above in the case when the boundary data belongs to $\mathrm{XMO}(\mathbb{R}^{n-1}, \mathbb{C}^N)$, which lines in between $\mathrm{CMO}(\mathbb{R}^{n-1}, \mathbb{C}^N)$ and $\mathrm{VMO}(\mathbb{R}^{n-1}, \mathbb{C}^N)$. Analogously, we formulate a new brand of strong Carleson measure conditions and a characterization of $\mathrm{XMO}(\mathbb{R}^{n-1}, \mathbb{C}^N)$ in terms of the traces of solutions of elliptic systems.


title: Amortized backward variational inference in nonlinear state-space models

abstract: We consider the problem of state estimation in general state-space models using variational inference. For a generic variational family defined using the same backward decomposition as the actual joint smoothing distribution, we establish for the first time that, under mixing assumptions, the variational approximation of expectations of additive state functionals induces an error which grows at most linearly in the number of observations. This guarantee is consistent with the known upper bounds for the approximation of smoothing distributions using standard Monte Carlo methods. Moreover, we propose an amortized inference framework where a neural network shared over all times steps outputs the parameters of the variational kernels. We also study empirically parametrizations which allow analytical marginalization of the variational distributions, and therefore lead to efficient smoothing algorithms. Significant improvements are made over state-of-the art variational solutions, especially when the generative model depends on a strongly nonlinear and noninjective mixing function.


title: Mittag--Leffler Euler integrator and large deviations for stochastic space-time fractional diffusion equations

abstract: Stochastic space-time fractional diffusion equations often appear in the modeling of the heat propagation in non-homogeneous medium. In this paper, we firstly investigate the Mittag--Leffler Euler integrator of a class of stochastic space-time fractional diffusion equations, whose super-convergence order is obtained by developing a helpful decomposition way for the time-fractional integral. Here, the developed decomposition way is the key to dealing with the singularity of the solution operator. Moreover, we study the Freidlin--Wentzell type large deviation principles of the underlying equation and its Mittag--Leffler Euler integrator based on the weak convergence approach. In particular, we prove that the large deviation rate function of the Mittag--Leffler Euler integrator $\Gamma$-converges to that of the underlying equation.


title: Quantum speed limit from a quantum-state-diffusion method

abstract: Characterizing the most efficient evolution, the quantum speed limit (QSL) plays a significant role in quantum technology. How to generalize the well-established QSL from closed systems to open systems has attracted much attention. In contrast to the previous schemes to derive the QSL from the reduced dynamics of open system, we propose a QSL bound from the point of view of the total system consisting of the open system and its environment using a quantum-state-diffusion method. The application of our scheme to a two-level system reveals that the system possesses an infinite speedup capacity in the noiseless case, which is destroyed by the environment under the Born-Markovian approximation. It is interesting to find that the capacity in the noiseless case is recovered in the non-Markovian dynamics as long as a bound state is formed in the energy spectrum of the total system. Enriching the characterization schemes of the QSL, our result provides an efficient way to control the QSL of open systems.


title: Missed Opportunities: Measuring the Untapped TLS Support in the Industrial Internet of Things

abstract: The ongoing trend to move industrial appliances from previously isolated networks to the Internet requires fundamental changes in security to uphold secure and safe operation. Consequently, to ensure end-to-end secure communication and authentication, (i) traditional industrial protocols, e.g., Modbus, are retrofitted with TLS support, and (ii) modern protocols, e.g., MQTT, are directly designed to use TLS. To understand whether these changes indeed lead to secure Industrial Internet of Things deployments, i.e., using TLS-based protocols, which are configured according to security best practices, we perform an Internet-wide security assessment of ten industrial protocols covering the complete IPv4 address space. Our results show that both, retrofitted existing protocols and newly developed secure alternatives, are barely noticeable in the wild. While we find that new protocols have a higher TLS adoption rate than traditional protocols (7.2% vs. 0.4%), the overall adoption of TLS is comparably low (6.5% of hosts). Thus, most industrial deployments (934,736 hosts) are insecurely connected to the Internet. Furthermore, we identify that 42% of hosts with TLS support (26,665 hosts) show security deficits, e.g., missing access control. Finally, we show that support in configuring systems securely, e.g., via configuration templates, is promising to strengthen security.


title: Order estimate of functionals related to fractional Brownian motion and asymptotic expansion of the quadratic variation of fractional stochastic differential equation

abstract: We derive an asymptotic expansion for the quadratic variation of a stochastic process satisfying a stochastic differential equation driven by a fractional Brownian motion, based on the theory of asymptotic expansion of Skorohod integrals converging to a mixed normal limit. In order to apply the general theory, it is necessary to estimate functionals that are a randomly weighted sum of products of multiple integrals of the fractional Brownian motion, in expanding the quadratic variation and identifying the limit random symbols. To overcome the difficulty, we introduce two types of exponents by means of the "weighted graphs" capturing the structure of the sum in the functional, and investigate how the exponents change by the action of the Malliavin derivative and its projection.


title: Kostka numbers and Fourier duality

abstract: We relate the Fourier transform of perverse sheaves smooth along the coordinate hyperplane configuration in a complex vector space to the Deligne-Lusztig duality of unipotent representations of a general linear group over a finite field. A similar relation is established for arbitrary finite Coxeter groups.


title: LDoS attack detection method based on traffic time-frequency characteristics

abstract: For the traditional denial-of-service attack detection methods have complex algorithms and high computational overhead, which are difficult to meet the demand of online detection; and the experimental environment is mostly a simulation platform, which is difficult to deploy in real network environment, we propose a real network environment-oriented LDoS attack detection method based on the time-frequency characteristics of traffic data. All the traffic data flowing through the Web server is obtained through the acquisition storage system, and the detection data set is constructed using pre-processing; the simple features of the flow fragments are used as input, and the deep neural network is used to learn the time-frequency domain features of normal traffic features and generate reconstructed sequences, and the LDoS attack is discriminated based on the differences between the reconstructed sequences and the input data in the time-frequency domain. The experimental results show that the proposed method can accurately detect the attack features in the flow fragments in a very short time and achieve high detection accuracy for complex and diverse LDoS attacks; since only the statistical features of the packets are used, there is no need to parse the packet data, which can be adapted to different network environments.


title: Quantum energy current and quantum coherence of a spin chain in a non-Markovian environment

abstract: We investigate the behavior in time of the energy current between a quantum spin chain and its surrounding non-Markovian, finite temperature baths, together with its relationship to the coherence dynamics of the system. To be specific, both the system and the baths are assumed to be initially in thermal equilibrium at temperature $T_s$ and $T_b$, respectively. This model plays a fundamental role for the study of quantum system evolution towards thermal equilibrium in an open system. The non-Markovian quantum state diffusion (NMQSD) equation approach is used to calculate the dynamics of the spin chain. The effects of bath non-Markovinity, temperature difference and system-bath interaction strength on the energy current and the coherence in warm and cold baths are analyzed, respectively. For both cases, our calculation results show that strong non-Markovianity, weak system-bath interaction and low temperature difference will be helpful to maintain the coherence of the system and correspond to a small energy current. Interestingly, the warm baths destroy the coherence while the cold baths help to generate coherence. Furthermore, the effects of the Dzyaloshinskii-Moriya ($DM$) interaction and the external magnetic field on the energy current and coherence are analyzed. Both energy current and coherence will change due to the improvement of the system energy induced by the $DM$ interaction and magnetic field. Significantly, the lowest coherence corresponds to the critical magnetic field which causes the first order phase transition.


title: Improved Successive Branch Reduction for Stochastic Distribution Network Reconfiguration

abstract: We propose an improved successive branch reduction (SBR) method to solve stochastic distribution network reconfiguration (SDNR), a mixed-integer program that is known to be computationally challenging. First, for a special distribution network with a single redundant branch, we propose an improved design for a one-stage SBR algorithm in the literature to incorporate uncertain renewable generations and loads. Based on solving stochastic optimal power flow, the improved algorithm identifies and searches through a small set of candidate branches, from which it determines the optimal branch to open and obtains a radial network with the minimum expected operational cost. Then, for a general network with multiple redundant branches, we design a heuristic two-stage SBR algorithm based on a close-and-open procedure that iteratively runs the proposed one-stage SBR algorithm. Numerical results on the IEEE 33-bus and 123-bus distribution network models verify the proposed method in terms of optimality and computational efficiency.


title: A crypto-regularity result for the micropolar fluids equations

abstract: In the analysis of PDEs, regularity of often measured in terms of Sobolev, H{\"o}lder, Besov or Lipschitz spaces, etc. However, sometimes a gain of regularity can also be expressed just in terms of Lebesgue spaces, by passing from a singular setting to a less singular one. In this article we will obtain a gain of integrability for weak solutions of the micropolar fluid equations using as general framework Morrey spaces, which is a very useful language to study regularity in PDEs. An interesting point is that the two variables of the micropolar fluid equations can be studied separately.


title: How environment affects active particle swarms: a case study

abstract: We investigate the collective motion of self-propelled agents in an environment filled with obstacles that are tethered to fixed positions via springs. The active particles are able to modify the environment by moving the obstacles through repulsion forces. This creates feedback interactions between the particles and the obstacles from which a breadth of patterns emerges (trails, band, clusters, honey-comb structures,...). We will focus on a discrete model first introduced in [Aceves2020] and derived into a continuum PDE model. As a first major novelty, we perform an in-depth investigation of pattern formation of the discrete and continuum models in 2D: we provide phase-diagrams and determine the key mechanisms for bifurcations to happen using linear stability analysis. As a result, we discover that the agent-agent repulsion, the agent-obstacle repulsion and the obstacle's spring stiffness are the key forces in the appearance of patterns, while alignment forces between the particles play a secondary role. The second major novelty lies in the development of an innovative methodology to compare discrete and continuum models that we apply here to perform an in-depth analysis of the agreement between the discrete and continuum models.


title: B2T Connection: Serving Stability and Performance in Deep Transformers

abstract: From the perspective of the layer normalization (LN) positions, the architectures of Transformers can be categorized into two types: Post-LN and Pre-LN. Recent Transformers tend to be Pre-LN because, in Post-LN with deep Transformers (e.g., those with ten or more layers), the training is often unstable, resulting in useless models. However, Post-LN has consistently achieved better performance than Pre-LN in relatively shallow Transformers (e.g., those with six or fewer layers). This study first investigates the reason for these discrepant observations empirically and theoretically and made the following discoveries: 1, the LN in Post-LN is the main source of the vanishing gradient problem that leads to unstable training, whereas Pre-LN prevents it, and 2, Post-LN tends to preserve larger gradient norms in higher layers during the back-propagation, which may lead to effective training. Exploiting the new findings, we propose a method that can provide both high stability and effective training by a simple modification of Post-LN. We conduct experiments on a wide range of text generation tasks. The experimental results demonstrate that our method outperforms Pre-LN, and enables stable training regardless of the shallow or deep layer settings. Our code is publicly available at https://github.com/takase/b2t_connection.


title: On slopes of isodual lattices

abstract: The slope filtration of Euclidean lattices was introduced in works by Stuhler in the late 1970s, extended by Grayson a few years later, as a new tool for reduction theory and its applications to the study of arithmetic groups. Lattices with trivial filtration are called semistable, in keeping with a classical terminology. In 1997, Bost conjectured that the tensor product of semistable lattices should be semistable itself. Our aim in this work is to study these questions for the restricted class of isodual lattices. Such lattices appear in a wide range of contexts, and it is rather natural to study their slope filtration. We exhibit specific properties in this case, which allow, in turn, to prove some new particular cases of Bost's conjecture.


title: Smart Channel State Information Pre-processing for Joint Authentication and Secret Key Distillation

abstract: While the literature on RF fingerprinting-based authentication and key distillation is vast, the two topics have customarily been studied separately. In this paper, starting from the observation that the wireless channel is a composite, deterministic / stochastic process, we propose a power domain decomposition that allows performing the two tasks simultaneously. We devise intelligent pre-processing schemes to decompose channel state information (CSI) observation vectors into "predictable" and "unpredictable" components. The former, primarily due to large-scale fading, can be used for node authentication through RF fingerprinting. The latter, primarily due to small-scale fading, could be used for semantically secure secret key generation (SKG). To perform the decomposition, we propose: (i) a fingerprint "separability" criterion, expressed through the maximisation of the total variation distance between the empirical fingerprint measures; (ii) a statistical independence metric for observations collected at different users, expressed through a normalised version of the $d$-dimensional Hilbert Schmidt independence criterion (dHSIC) test statistic. We propose both explicit implementations, using principal component analysis (PCA) and kernel PCA and black-box, unsupervised learning, using autoencoders. Our experiments on synthetic and real CSI datasets showcase that the incorporation of RF fingerprinting and SKG, with explicit security guarantees, is tangible in future generations of wireless.


title: $\mathcal{S}$-adic characterization of minimal dendric shifts

abstract: Dendric shifts are defined by combinatorial restrictions of the extensions of the words in their languages. This family generalizes well-known families of shifts such as Sturmian shifts, Arnoux-Rauzy shifts and codings of interval exchange transformations. It is known that any minimal dendric shift has a primitive $\mathcal{S}$-adic representation where the morphisms in $\mathcal{S}$ are positive tame automorphisms of the free group generated by the alphabet. In this paper we give an $\mathcal{S}$-adic characterization of this family by means of two finite graphs. As an application, we are able to decide whether a shift space generated by a uniformly recurrent morphic word is (eventually) dendric.


title: On the Hardness of Dominant Strategy Mechanism Design

abstract: We study the communication complexity of dominant strategy implementations of combinatorial auctions. We start with two domains that are generally considered "easy": multi-unit auctions with decreasing marginal values and combinatorial auctions with gross substitutes valuations. For both domains we have fast algorithms that find the welfare-maximizing allocation with communication complexity that is poly-logarithmic in the input size. This immediately implies that welfare maximization can be achieved in ex-post equilibrium with no significant communication cost, by using VCG payments. In contrast, we show that in both domains the communication complexity of any dominant strategy implementation that achieves the optimal welfare is polynomial in the input size. We then move on to studying the approximation ratios achievable by dominant strategy mechanisms. For multi-unit auctions with decreasing marginal values, we provide a dominant-strategy communication FPTAS. For combinatorial auctions with general valuations, we show that there is no dominant strategy mechanism that achieves an approximation ratio better than $m^{1-\epsilon}$ that uses $poly(m,n)$ bits of communication, where $m$ is the number of items and $n$ is the number of bidders. In contrast, a \emph{randomized} dominant strategy mechanism that achieves an $O(\sqrt m)$ approximation with $poly(m,n)$ communication is known. This proves the first gap between computationally efficient deterministic dominant strategy mechanisms and randomized ones. En route, we answer an open question on the communication cost of implementing dominant strategy mechanisms for more than two players, and also solve some open problems in the area of simultaneous combinatorial auctions.


title: Putting AI Ethics into Practice: The Hourglass Model of Organizational AI Governance

abstract: The organizational use of artificial intelligence (AI) has rapidly spread across various sectors. Alongside the awareness of the benefits brought by AI, there is a growing consensus on the necessity of tackling the risks and potential harms, such as bias and discrimination, brought about by advanced AI technologies. A multitude of AI ethics principles have been proposed to tackle these risks, but the outlines of organizational processes and practices for ensuring socially responsible AI development are in a nascent state. To address the paucity of comprehensive governance models, we present an AI governance framework, the hourglass model of organizational AI governance, which targets organizations that develop and use AI systems. The framework is designed to help organizations deploying AI systems translate ethical AI principles into practice and align their AI systems and processes with the forthcoming European AI Act. The hourglass framework includes governance requirements at the environmental, organizational, and AI system levels. At the AI system level, we connect governance requirements to AI system life cycles to ensure governance throughout the system's life span. The governance model highlights the systemic nature of AI governance and opens new research avenues into its practical implementation, the mechanisms that connect different AI governance layers, and the dynamics between the AI governance actors. The model also offers a starting point for organizational decision-makers to consider the governance components needed to ensure social acceptability, mitigate risks, and realize the potential of AI.


title: Formal frames and deformations of affine connections

abstract: We will introduce formal frames of manifolds, which are a generalization of ordinary frames. Their fundamental properties are discussed. In particular, canonical forms are introduced, and torsions are defined in terms of them as a generalization of the structural equations. It will be shown that the vanishing of torsions are equivalent to the realizability of given formal frames as ordinary frames. We will also discuss deformations of linear connections on tangent bundles. An application to deformations of foliations are then given.


title: Insertion of real agents behaviors in CARLA autonomous driving simulator

abstract: The role of simulation in autonomous driving is becoming increasingly important due to the need for rapid prototyping and extensive testing. The use of physics-based simulation involves multiple benefits and advantages at a reasonable cost while eliminating risks to prototypes, drivers and vulnerable road users. However, there are two main limitations. First, the well-known reality gap which refers to the discrepancy between reality and simulation that prevents simulated autonomous driving experience from enabling effective real-world performance. Second, the lack of empirical knowledge about the behavior of real agents, including backup drivers or passengers and other road users such as vehicles, pedestrians or cyclists. Agent simulation is usually pre-programmed deterministically, randomized probabilistically or generated based on real data, but it does not represent behaviors from real agents interacting with the specific simulated scenario. In this paper we present a preliminary framework to enable real-time interaction between real agents and the simulated environment (including autonomous vehicles) and generate synthetic sequences from simulated sensor data from multiple views that can be used for training predictive systems that rely on behavioral models. Our approach integrates immersive virtual reality and human motion capture systems with the CARLA simulator for autonomous driving. We describe the proposed hardware and software architecture, and discuss about the so-called behavioural gap or presence. We present preliminary, but promising, results that support the potential of this methodology and discuss about future steps.


title: CellCentroidFormer: Combining Self-attention and Convolution for Cell Detection

abstract: Cell detection in microscopy images is important to study how cells move and interact with their environment. Most recent deep learning-based methods for cell detection use convolutional neural networks (CNNs). However, inspired by the success in other computer vision applications, vision transformers (ViTs) are also used for this purpose. We propose a novel hybrid CNN-ViT model for cell detection in microscopy images to exploit the advantages of both types of deep learning models. We employ an efficient CNN, that was pre-trained on the ImageNet dataset, to extract image features and utilize transfer learning to reduce the amount of required training data. Extracted image features are further processed by a combination of convolutional and transformer layers, so that the convolutional layers can focus on local information and the transformer layers on global information. Our centroid-based cell detection method represents cells as ellipses and is end-to-end trainable. Furthermore, we show that our proposed model can outperform fully convolutional one-stage detectors on four different 2D microscopy datasets. Code is available at: https://github.com/roydenwa/cell-centroid-former


title: Adaptive time integration of mechanical forces in center-based models for biological cell populations

abstract: Center-based models are used to simulate the mechanical behavior of biological cells during embryonic development or cancer growth. To allow for the simulation of biological populations potentially growing from a few individual cells to many thousands or more, these models have to be numerically efficient, while being reasonably accurate on the level of individual cell trajectories. In this work, we increase the robustness, accuracy, and efficiency of the simulation of center-based models by choosing the time steps adaptively in the numerical method. We investigate the gain in using single rate time stepping for the forward and backward Euler methods, based on local estimates of the numerical errors and the stability of the method in the case of the explicit forward Euler method. Furthermore, we propose a multirate time stepping scheme that simulates regions with high local force gradients (e.g. as they happen after cell division) with multiple smaller time steps within a larger single time step for regions with smoother forces. These methods are compared for different model systems in numerical experiments. We conclude that the adaptive single rate forward Euler method results in significant gains in terms of reduced wall clock times for the simulation of a linearly growing tissue, while at the same time eliminating the need for manual determination of a suitable time step size.


title: On the latency of multi-level polar coded modulations

abstract: A commonly assumed drawback of multi-level coding, compared to a bit-interleaved coded modulation, is its high latency: Indeed, the levels must be decoded sequentially. In this paper, we consider polar codes to code each level. We show that the decoding time complexity of the multi-level scheme, using successive-cancellation list decoding for each polar code, is only 1.5 times the one of a single polar code, regardless of the signal-to-noise ratio and the number of levels.


title: Ergodic behaviors of composition operators acting on space of bounded holomorphic functions

abstract: We completely characterize the mean ergodic composition operators on $H^\infty(\mathbb{B}_n)$. In particular, we show that a composition operator acting on this space is mean ergodic if and only if it is uniformly mean ergodic.


title: Control of Two-way Coupled Fluid Systems with Differentiable Solvers

abstract: We investigate the use of deep neural networks to control complex nonlinear dynamical systems, specifically the movement of a rigid body immersed in a fluid. We solve the Navier Stokes equations with two way coupling, which gives rise to nonlinear perturbations that make the control task very challenging. Neural networks are trained in an unsupervised way to act as controllers with desired characteristics through a process of learning from a differentiable simulator. Here we introduce a set of physically interpretable loss terms to let the networks learn robust and stable interactions. We demonstrate that controllers trained in a canonical setting with quiescent initial conditions reliably generalize to varied and challenging environments such as previously unseen inflow conditions and forcing, although they do not have any fluid information as input. Further, we show that controllers trained with our approach outperform a variety of classical and learned alternatives in terms of evaluation metrics and generalization capabilities.


title: Towards view-invariant vehicle speed detection from driving simulator images

abstract: The use of cameras for vehicle speed measurement is much more cost effective compared to other technologies such as inductive loops, radar or laser. However, accurate speed measurement remains a challenge due to the inherent limitations of cameras to provide accurate range estimates. In addition, classical vision-based methods are very sensitive to extrinsic calibration between the camera and the road. In this context, the use of data-driven approaches appears as an interesting alternative. However, data collection requires a complex and costly setup to record videos under real traffic conditions from the camera synchronized with a high-precision speed sensor to generate the ground truth speed values. It has recently been demonstrated that the use of driving simulators (e.g., CARLA) can serve as a robust alternative for generating large synthetic datasets to enable the application of deep learning techniques for vehicle speed estimation for a single camera. In this paper, we study the same problem using multiple cameras in different virtual locations and with different extrinsic parameters. We address the question of whether complex 3D-CNN architectures are capable of implicitly learning view-invariant speeds using a single model, or whether view-specific models are more appropriate. The results are very promising as they show that a single model with data from multiple views reports even better accuracy than camera-specific models, paving the way towards a view-invariant vehicle speed measurement system.


title: Self-Supervised Learning as a Means To Reduce the Need for Labeled Data in Medical Image Analysis

abstract: One of the largest problems in medical image processing is the lack of annotated data. Labeling medical images often requires highly trained experts and can be a time-consuming process. In this paper, we evaluate a method of reducing the need for labeled data in medical image object detection by using self-supervised neural network pretraining. We use a dataset of chest X-ray images with bounding box labels for 13 different classes of anomalies. The networks are pretrained on a percentage of the dataset without labels and then fine-tuned on the rest of the dataset. We show that it is possible to achieve similar performance to a fully supervised model in terms of mean average precision and accuracy with only 60\% of the labeled data. We also show that it is possible to increase the maximum performance of a fully-supervised model by adding a self-supervised pretraining step, and this effect can be observed with even a small amount of unlabeled data for pretraining.


title: A predictive microstructure-based approach for the anisotropic damage, residual stretches and hysteresis in biodegradable sutures

abstract: We propose a predictive model for the mechanical behavior of biodegradable polymers of interest for biomedical applications. Starting from a detailed description of the network behavior of the copolymer material, taking care of bonds breaking and recrosslinking effects, folded-unfolded transitions and network topological constraints, we deduce a macroscopic law for the complex mechanical behavior of many biomedical materials with a particular focus on absorbable suture threads and a perspective to new material design. A crucial novelty of the model is the careful description of the observed microscopic anisotropic damage induced by the deformation, here described based on the classical microsphere integration approach. The resulting energy, characterized by a few number of material parameters, with physically clear interpretation, is successfully adopted to predict our cyclic experiments on poliglecaprone sutures with anisotropic damage, permanent stretch and internal hysteresis. By also studying other suture materials behavior we show that the predictivity properties of the model can be extended also to materials with a different mechanical response and thus also possibly applied for the design of new, high-performance biomedical materials.


title: Dynamic negative capacitance regime in GeTe Rashba ferroelectric

abstract: We experimentally investigate capacitance response of a thick ferroelectric GeTe single-crystal flake on the Si/SiO2 substrate, where p-doped Si layer serves as a gate electrode. We confirm by resistance measurements, that for three-dimensional flakes, electron concentration is not sensitive to the gate electric field due to the screening by bulk carriers. Unexpectedly, we observe that sample capacitance C is strongly diminishing for both gate field polarities, so C(Vg) is a maximum near the zero gate voltage. Also, we observe well-developed hysteresis with the gate voltage sweep direction for the experimental C(Vg) curves. From our analysis, the capacitance behavior is explained by the known dependence of the Rashba parameter on the electric field for giant Rashba splitting in GeTe. In this case, the hysteresis in capacitance should be ascribed to polarization evolution in GeTe surface layers, which also allows to realize the regime of dynamic negative capacitance. The latter can be directly observed in time-dependent resistive measurements, as non-monotonic evolution of voltage response to the step-like current pulse. Thus, the negative capacitance regime can indeed improve performance and, therefore, the energy efficiency of electronic devices.


title: Comparative statics with adjustment costs and the le Chatelier principle

abstract: We develop a theory of monotone comparative statics for models with adjustment costs. We show that comparative-statics conclusions may be drawn under the usual ordinal complementarity assumptions on the objective function, assuming very little about costs: only a mild monotonicity condition is required. We use this insight to prove a general le Chatelier principle: under the ordinal complementarity assumptions, if short-run adjustment is subject to a monotone cost, then the long-run response to a shock is greater than the short-run response. We extend these results to a fully dynamic model of adjustment over time: the le Chatelier principle remains valid, and under slightly stronger assumptions, optimal adjustment follows a monotone path. We apply our results to models of saving, production, pricing, labor supply and investment.


title: New extraction of CP violation in b-baryon decays

abstract: We study CP violation in b-baryon decays of $\Xi_b^- \to \Xi^- D$ with $D = D^0, \bar{D}^0$ and $D_i~(i=1,2)$. We find that these baryonic decay processes provide an ideal opportunity to measure the weak phase due to the absence of the relative strong phase. Explicitly, we relate $\bar{\rho}$ and $\bar{\eta}$ the CKM elements with the decay rate ratios of $R_i= \Gamma(\Xi_b^- \to \Xi^-D_{i} ) / \Gamma( \Xi_b^- \to \Xi^-D^0 )$ without the charge conjugate states. As a complementary, we also examine the decay distributions of $\Lambda_b \to \Lambda(\to p \pi^- ) D$. There are in total 32 decay observables, which can be parameterized by 9 real parameters, allowing the experiments to extract the angle $\gamma\equiv \arg(-V_{ud}V_{ub}^*/V_{cd}V_{cb}^*)$ in the CKM unitarity triangle. In addition, the feasibilities of the experimental measurements are discussed. We find that $\bar{\rho}$ and $\bar{\eta}$ can be extracted at LHCb Run3 from $\Xi_b^- \to \Xi^- D$, and a full analysis of $\Lambda_b \to \Lambda(\to p \pi^-)D$ is available at LHCb Run4.


title: Games for Hybrid Logic -- From Semantic Games to Analytic Calculi

abstract: Game semantics and winning strategies offer a potential conceptual bridge between semantics and proof systems of logics. We illustrate this link for hybrid logic -- an extension of modal logic that allows for explicit reference to worlds within the language. The main result is that the systematic search of winning strategies over all models can be finitized and thus reformulated as a proof system.


title: Radical Addition and H Abstraction Reactions in C2H2, C2H4 and C2H6: A Gateway for Ethyl and Vinyl Bearing Molecules in the Interstellar Medium

abstract: Recent interstellar detections include a significant number of molecules containing vinyl (C2H3) and ethyl (C2H5) groups in their structure. For several of these molecules, there is not a clear experimental or theoretical evidence that support their formation from simpler precursors. We carried out a systematic search of viable reactions starting from closed shell hydrocarbons containing two carbon atoms (ethane, C2H6; ethylene, C2H4; and acetylene, C2H2) with the goal of determining viable chemical routes for the formation of vinyl and ethyl molecules on top of interstellar dust grains. Our results show that both H and OH radicals are key in converting acetylene and ethylene into more complex radicals that are susceptible to continue reacting and forming interstellar complex organic molecules. The relevant reactions, for example OH additions, present rate constants above 10$^{1}$ s$^{-1}$ that are likely competitive with OH diffusion on grains. Similarly, H atom addition to acetylene and ethylene is a very fast process with rate constants above 10$^{4}$ s$^{-1}$ in all cases, and greatly enhanced by quantum tunneling. Hydrogen abstraction reactions are less relevant, but may play a role in specific cases involving the OH radical. Reactions with other radicals NH2, CH3 are likely to have a much lesser impact in the chemistry of ethyl and vinyl bearing molecules.


title: No universal graphs at uncountable regular cardinals

abstract: Assuming the existence of a strong cardinal, we find a model of ZFC in which for each uncountable regular cardinal $\lambda,$ there is no universal graph of size $\lambda$.


title: Support Vector Machines under Adversarial Label Contamination

abstract: Machine learning algorithms are increasingly being applied in security-related tasks such as spam and malware detection, although their security properties against deliberate attacks have not yet been widely understood. Intelligent and adaptive attackers may indeed exploit specific vulnerabilities exposed by machine learning techniques to violate system security. Being robust to adversarial data manipulation is thus an important, additional requirement for machine learning algorithms to successfully operate in adversarial settings. In this work, we evaluate the security of Support Vector Machines (SVMs) to well-crafted, adversarial label noise attacks. In particular, we consider an attacker that aims to maximize the SVM's classification error by flipping a number of labels in the training data. We formalize a corresponding optimal attack strategy, and solve it by means of heuristic approaches to keep the computational complexity tractable. We report an extensive experimental analysis on the effectiveness of the considered attacks against linear and non-linear SVMs, both on synthetic and real-world datasets. We finally argue that our approach can also provide useful insights for developing more secure SVM learning algorithms, and also novel techniques in a number of related research areas, such as semi-supervised and active learning.


title: Expansivity and strong structural stability for composition operators on $L^p$ spaces

abstract: In this note we investigate the two notions of expansivity and strong structural stability for composition operators on $L^p$ spaces, $1 \leq p < \infty$. Necessary and sufficient conditions for such operators to be expansive are provided, both in the general and the dissipative case. We also show that, in the dissipative setting, the shadowing property implies the strong structural stability and we prove that these two notions are equivalent under the extra hypothesis of positive expansivity.


title: Synthesizing Safety Controllers for Uncertain Linear Systems: A Direct Data-driven Approach

abstract: In this paper, we provide a direct data-driven approach to synthesize safety controllers for unknown linear systems affected by unknown-but-bounded disturbances, in which identifying the unknown model is not required. First, we propose a notion of $\gamma$-robust safety invariant ($\gamma$-RSI) sets and their associated state-feedback controllers, which can be applied to enforce invariance properties. Then, we formulate a data-driven computation of these sets in terms of convex optimization problems with linear matrix inequalities (LMI) as constraints, which can be solved based on a finite number of data collected from a single input-state trajectory of the system. To show the effectiveness of the proposed approach, we apply our results to a 4-dimensional inverted pendulum.


title: Regularized by Physics: Graph Neural Network Parametrized Potentials for the Description of Intermolecular Interactions

abstract: Simulations with an explicit description of intermolecular forces using electronic structure methods are still not feasible for many systems of interest. As a result, empirical methods such as force fields (FF) have become an established tool for the simulation of large and complex molecular systems. However, the parametrization of FF is time consuming and has traditionally been based largely on experimental data, which is scarce for many functional groups. Recent years have therefore seen increasing efforts to automatize FF parametrization and a move towards FF fitted against quantum-mechanical reference data. Here, we propose an alternative strategy to parametrize intermolecular interactions, which makes use of machine learning and gradient-descent based optimization while retaining a functional form founded in physics. This strategy can be viewed as generalization of existing FF parametrization methods. In the proposed approach, graph neural networks are used in conjunction with automatic differentiation to parametrize physically motivated models to potential-energy surfaces, enabling full automatization and broad applicability in chemical space. As a result, highly accurate FF models are obtained which retain the computational efficiency, interpretability and robustness of classical FF. To showcase the potential of the proposed method, both a fixed-charge model and a polarizable model are parametrized for intermolecular interactions and applied to a wide range of systems including dimer dissociation curves and condensed-phase systems.


title: A Survey on Deep Learning for Skin Lesion Segmentation

abstract: Skin cancer is a major public health problem that could benefit from computer-aided diagnosis to reduce the burden of this common disease. Skin lesion segmentation from images is an important step toward achieving this goal. However, the presence of natural and artificial artifacts (e.g., hair and air bubbles), intrinsic factors (e.g., lesion shape and contrast), and variations in image acquisition conditions make skin lesion segmentation a challenging task. Recently, various researchers have explored the applicability of deep learning models to skin lesion segmentation. In this survey, we cross-examine 177 research papers that deal with deep learning-based segmentation of skin lesions. We analyze these works along several dimensions, including input data (datasets, preprocessing, and synthetic data generation), model design (architecture, modules, and losses), and evaluation aspects (data annotation requirements and segmentation performance). We discuss these dimensions both from the viewpoint of select seminal works, and from a systematic viewpoint, examining how those choices have influenced current trends, and how their limitations should be addressed. To facilitate comparisons, we summarize all examined works in a comprehensive table as well as an interactive table available online at https://github.com/sfu-mial/skin-lesion-segmentation-survey.


title: Propagation of epidemics in a polarized society: impact of clustering among unvaccinated individuals

abstract: Polarization of opinions about vaccination can have a negative impact on pandemic control. In this work we quantify this negative impact for the transmission of COVID-19, using an agent based simulation in an heterogeneous population with multi-type networks, representing different types of social interactions. We show that the clustering of unvaccinated individuals, associated with polarization of opinion, can lead to significant differences in the evolution of the pandemic compared to deterministic model predictions. Under our realistic baseline scenario these differences are a 33pc increase of the effective reproduction number, a 157pc increase of infections at the peak and a 30pc increase in the final cumulative attack rate.


title: Computation of $\lambda$-classes via strata of differentials

abstract: We introduce a new family of tautological relations of the moduli space of stable curves of genus $g$. These relations are obtained by computing the Poincar\'e-dual class of empty loci in the Hodge bundle. We use these relations to obtain a new expression for the Chern classes of the Hodge bundle. We prove that the $(g-i)$th class can be expressed as a linear combination of tautological classes involving only stable graphs with at most $i$ loops. In particular the top Chern class may be expressed with trees. This property was expected as a consequence of the DR/DZ equivalence conjecture by Buryak-Gu\'er\'e-Rossi.


title: DeepCluE: Enhanced Image Clustering via Multi-layer Ensembles in Deep Neural Networks

abstract: Deep clustering has recently emerged as a promising technique for complex data clustering. Despite the considerable progress, previous deep clustering works mostly build or learn the final clustering by only utilizing a single layer of representation, e.g., by performing the K-means clustering on the last fully-connected layer or by associating some clustering loss to a specific layer, which neglect the possibilities of jointly leveraging multi-layer representations for enhancing the deep clustering performance. In view of this, this paper presents a Deep Clustering via Ensembles (DeepCluE) approach, which bridges the gap between deep clustering and ensemble clustering by harnessing the power of multiple layers in deep neural networks. In particular, we utilize a weight-sharing convolutional neural network as the backbone, which is trained with both the instance-level contrastive learning (via an instance projector) and the cluster-level contrastive learning (via a cluster projector) in an unsupervised manner. Thereafter, multiple layers of feature representations are extracted from the trained network, upon which the ensemble clustering process is further conducted. Specifically, a set of diversified base clusterings are generated from the multi-layer representations via a highly efficient clusterer. Then the reliability of clusters in multiple base clusterings is automatically estimated by exploiting an entropy-based criterion, based on which the set of base clusterings are re-formulated into a weighted-cluster bipartite graph. By partitioning this bipartite graph via transfer cut, the final consensus clustering can be obtained. Experimental results on six image datasets confirm the advantages of DeepCluE over the state-of-the-art deep clustering approaches.


title: Ladder of Eckhaus instabilities and parametric conversion in chi(2) microresonators

abstract: Low loss microresonators have revolutionised nonlinear and quantum optics over the past decade. In particular, microresonators with the second order, chi(2), nonlinearity have the advantages of broad spectral tunability and low power frequency conversion. Recent observations have highlighted that the parametric frequency conversion in chi(2) microresonators is accompanied by stepwise changes in the signal and idler frequencies. Therefore, a better understanding of the mechanisms and development of the theory underpinning this behaviour is timely. Here, we report that the stepwise frequency conversion originates from the discrete sequence of the so-called Eckhaus instabilities. After discovering these instabilities in fluid dynamics in the 1960s, they have become a broadly spread interdisciplinary concept. Now, we demonstrate that the Eckhaus mechanism also underpins the ladder-like structure of the frequency tuning curves in chi(2) microresonators.


title: Weak localization in p-type heterostructures in the presence of parallel magnetic field

abstract: Theory of weak localization is developed for two-dimensional holes in the presence of in-plane magnetic field. The Zeeman splitting even in the hole momentum results in the spin-dependent phase changing the quantum interference. The negative correction to the conductivity is shown to decrease by a factor of two by the in-plane magnetic field. The positive magnetoconductivity in a classically weak perpendicular field caused by the weak localization is calculated for both quadratic and quartic in momentum Zeeman hole splittings. Calculations show that the conductivity corrections are very close to each other in these two cases of low and high hole density.


title: An Empirical Study of Retrieval-enhanced Graph Neural Networks

abstract: Graph Neural Networks (GNNs) are effective tools for graph representation learning. Most GNNs rely on a recursive neighborhood aggregation scheme, named message passing, thereby their theoretical expressive power is limited to the first-order Weisfeiler-Lehman test (1-WL). An effective approach to this challenge is to explicitly retrieve some annotated examples used to enhance GNN models. While retrieval-enhanced models have been proved to be effective in many language and vision domains, it remains an open question how effective retrieval-enhanced GNNs are when applied to graph datasets. Motivated by this, we want to explore how the retrieval idea can help augment the useful information learned in the graph neural networks, and we design a retrieval-enhanced scheme called GRAPHRETRIEVAL, which is agnostic to the choice of graph neural network models. In GRAPHRETRIEVAL, for each input graph, similar graphs together with their ground-true labels are retrieved from an existing database. Thus they can act as a potential enhancement to complete various graph property predictive tasks. We conduct comprehensive experiments over 13 datasets, and we observe that GRAPHRETRIEVAL is able to reach substantial improvements over existing GNNs. Moreover, our empirical study also illustrates that retrieval enhancement is a promising remedy for alleviating the long-tailed label distribution problem.


title: Bring Your Own Algorithm for Optimal Differentially Private Stochastic Minimax Optimization

abstract: We study differentially private (DP) algorithms for smooth stochastic minimax optimization, with stochastic minimization as a byproduct. The holy grail of these settings is to guarantee the optimal trade-off between the privacy and the excess population loss, using an algorithm with a linear time-complexity in the number of training samples. We provide a general framework for solving differentially private stochastic minimax optimization (DP-SMO) problems, which enables the practitioners to bring their own base optimization algorithm and use it as a black-box to obtain the near-optimal privacy-loss trade-off. Our framework is inspired from the recently proposed Phased-ERM method [22] for nonsmooth differentially private stochastic convex optimization (DP-SCO), which exploits the stability of the empirical risk minimization (ERM) for the privacy guarantee. The flexibility of our approach enables us to sidestep the requirement that the base algorithm needs to have bounded sensitivity, and allows the use of sophisticated variance-reduced accelerated methods to achieve near-linear time-complexity. To the best of our knowledge, these are the first near-linear time algorithms with near-optimal guarantees on the population duality gap for smooth DP-SMO, when the objective is (strongly-)convex--(strongly-)concave. Additionally, based on our flexible framework, we enrich the family of near-linear time algorithms for smooth DP-SCO with the near-optimal privacy-loss trade-off.


title: Elucidating the Design Space of Diffusion-Based Generative Models

abstract: We argue that the theory and practice of diffusion-based generative models are currently unnecessarily convoluted and seek to remedy the situation by presenting a design space that clearly separates the concrete design choices. This lets us identify several changes to both the sampling and training processes, as well as preconditioning of the score networks. Together, our improvements yield new state-of-the-art FID of 1.79 for CIFAR-10 in a class-conditional setting and 1.97 in an unconditional setting, with much faster sampling (35 network evaluations per image) than prior designs. To further demonstrate their modular nature, we show that our design changes dramatically improve both the efficiency and quality obtainable with pre-trained score networks from previous work, including improving the FID of a previously trained ImageNet-64 model from 2.07 to near-SOTA 1.55, and after re-training with our proposed improvements to a new SOTA of 1.36.


title: ORKA: Object reconstruction using a K-approximation graph

abstract: Data processing has to deal with many practical difficulties. Data is often corrupted by artifacts or noise and acquiring data can be expensive and difficult. Thus, the given data is often incomplete and inaccurate. To overcome these problems, it is often assumed that the data is sparse or low-dimensional in some domain. When multiple measurements are taken, this sparsity often appears in a structured manner. We propose a new model that assumes the data only contains a few relevant objects, i.e., it is sparse in some object domain. We model an object as a structure that can only change slightly in form and continuously in position over different measurements. This can be modeled by a matrix with highly correlated columns and a column shift operator that we introduce in this work. We present an efficient algorithm to solve the object reconstruction problem based on a K-approximation graph. We prove optimal approximation bounds and perform a numerical evaluation of the method. Examples from applications including Geophysics, video processing, and others will be given.


title: Rectangular multiple-relaxation-time lattice Boltzmann method for the Navier-Stokes and nonlinear convection-diffusion equations: General equilibrium and some important issues

abstract: In this paper, we develop a general rectangular multiple-relaxation-time lattice Boltzmann (RMRT-LB) method for the Navier-Stokes equations (NSEs) and nonlinear convection-diffusion equation (NCDE) by extending our recent unified framework of MRT-LB method [Z.H. Chai and B.C. Shi, Phys. Rev. E 102, 023306 (2020)], where a rectangular equilibrium distribution function (REDF) [J.H. Lu et al, Phil. Trans. R. Soc. A 369, 2311-2319 (2011)] on a rectangular lattice is utilized. Due to the anisotropy of discrete velocities on a rectangular lattice, the third-order moment of REDF is inconsistent with that of popular LB method, and thus the previous unified framework of MRT-LB method cannot be directly applied to the NSEs using the REDF on the rectangular rDdQq lattice. The macroscopic NSEs can be recovered from the RMRT-LB method through the direct Taylor expansion method by properly selecting the relaxation sub-matrix $\mathbf{S}_2$ which is related to kinetic viscosity and bulk viscosity. While the rectangular lattice does not lead to the change of the zero-th, first and second-order moments of REDF, thus the unified framework of MRT-LB method can be directly applied to the NCDE. It should be noted that the RMRT-LB model for NSEs can be derived on the rDdQq lattice, including rD2Q9, rD3Q19, and rD3Q27 lattices, and the RMRT-LB versions (if existed) of the previous MRT-LB models can be obtained, including those based on raw (natural)-moment, central-moment, Hermite-moment, and central Hermite-moment, respectively.


title: Defining the Underlying-Event Activity in the Presence of Heavy-Flavour Processes in Proton-Proton Collisions at LHC Energies

abstract: We present a systematic analysis of heavy-flavour production in the underlying event in connection to a leading hard process in pp collisions at $\sqrt{s}$ = 13 TeV, using the PYTHIA 8 Monte Carlo event generator. We compare results from events selected by triggering on the leading hadron, as well as those triggered with reconstructed jets. We show that the kinematics of heavy-flavour fragmentation complicates the characterisation of the underlying event, and the usual method which uses the leading charged final-state hadron as a trigger may wash away the connection between the leading process and the heavy-flavour particle created in association with that. Events triggered with light or heavy-flavour jets, however, retain this connection and bring more direct information on the underlying heavy-flavour production process, but may also import unwanted sensitivity to gluon radiation. The methods outlined in the current work provide means to verify model calculations for light and heavy-flavour production in the jet and the underlying event in great details.


title: The Evolution of Competitiveness across Economic, Innovation and Knowledge production activities

abstract: The evolution of economic and innovation systems at the national scale is shaped by a complex dynamics, the footprint of which is the nested structure of the activities in which different countries are competitive. Nestedness is a persistent feature across multiple kinds (layers) of activities related to the production of knowledge and goods: scientific research, technological innovation, industrial production and trade. We observe that in the layers of innovation and trade the competitiveness of countries correlates unambiguously with their diversification, while the science layer displays some peculiar feature. The evolution of scientific domains leads to an increasingly modular structure, in which the most developed nations become less competitive in the less advanced scientific domains, where they are replaced by the emerging countries. This observation is in line with a capability-based view of the evolution of economic systems, but with a slight twist. Indeed, while the accumulation of specific know-how and skills is a fundamental step towards development, resource constraints force countries to acquire competitiveness in the more complex research fields at the price of losing ground in more basic, albeit less visible (or more crowded), fields. This tendency towards a relatively specialized basket of capabilities leads to a trade-off between the need to diversify in order to evolve and the need to allocate resources efficiently. Collaborative patterns among developed nations reduce the necessity to be competitive in the less sophisticated fields, freeing resources for the more complex domains.


title: Optical character recognition quality affects perceived usefulness of historical newspaper clippings

abstract: Introduction. We study effect of different quality optical character recognition in interactive information retrieval with a collection of one digitized historical Finnish newspaper. Method. This study is based on the simulated interactive information retrieval work task model. Thirty-two users made searches to an article collection of Finnish newspaper Uusi Suometar 1869-1918 with ca. 1.45 million auto segmented articles. Our article search database had two versions of each article with different quality optical character recognition. Each user performed six pre-formulated and six self-formulated short queries and evaluated subjectively the top-10 results using graded relevance scale of 0-3 without knowing about the optical character recognition quality differences of the otherwise identical articles. Analysis. Analysis of the user evaluations was performed by comparing mean averages of evaluations scores in user sessions. Differences of query results were detected by analysing lengths of returned articles in pre-formulated and self-formulated queries and number of different documents retrieved overall in these two sessions. Results. The main result of the study is that improved optical character recognition quality affects perceived usefulness of historical newspaper articles positively. Conclusions. We were able to show that improvement in optical character recognition quality of documents leads to higher mean relevance evaluation scores of query results in our historical newspaper collection. To the best of our knowledge this simulated interactive user-task is the first one showing empirically that users' subjective relevance assessments are affected by a change in the quality of optically read text.


title: Simulation of dielectric axion haloscopes with deep neural networks: a proof-of-principle

abstract: Dielectric axion haloscopes, such as the MADMAX experiment, are promising concepts for the direct search for dark matter axions. A reliable simulation is a fundamental requirement for the successful realisation of the experiments. Due to the complexity of the simulations, the demands on computing resources can quickly become prohibitive. In this paper, we show for the first time that modern deep learning techniques can be applied to aid the simulation and optimisation of dielectric haloscopes.


title: Dynamic Complexity of Group Problems

abstract: Dynamic Complexity was introduced by Immerman and Patnaik PI97 in the nineties and has seen a resurgence of interest with the positive resolution of their conjecture on directed reachability in DynFO DKMSZ18. Since then many natural problems related to reachability and matching have been placed in DynFO and related classes DMVZ18,DKMTVZ20,DTV21. In this work, we place some dynamic problems from group theory in DynFO. In particular, suppose we are given an arbitrary multiplication table over n elements representing an unstructured binary operation (representing a structure called a magma). Suppose the table evolves through a change in one of its n^2 entries in one step. For a set S of magma elements which also changes one element at a time, we can maintain enough auxiliary information so that when the magma is a group, we are able to answer the Cayley Group Membership (CGM) problem for S and a target t (i.e. "Is t a product of elements from S? ") using an FO query at every step. This places the dynamic CGM problem (for groups) when the ambient magma is specified via a table in DynFO. In contrast, for the table setting, statically CGM was known to be in the class Logspace BarringtonM06. Building on the dynamic CGM result, we can maintain the isomorphism of of two magmas, whenever both are Abelian groups, in DynFO. Our techniques include a way to maintain the powers of the elements of a magma in DynFO using left associative parenthesisation, the notion of cube independence to cube generate a subgroup generated by a set, a way to maintain maximal cube independent sequences in a magma along with some group theoretic machinery available from McKenzieCook. The notion of cube independent sequences is new as far as we know and may be of independent interest. These techniques are very different from the ones employed in Dynamic Complexity so far.


title: BD-SHS: A Benchmark Dataset for Learning to Detect Online Bangla Hate Speech in Different Social Contexts

abstract: Social media platforms and online streaming services have spawned a new breed of Hate Speech (HS). Due to the massive amount of user-generated content on these sites, modern machine learning techniques are found to be feasible and cost-effective to tackle this problem. However, linguistically diverse datasets covering different social contexts in which offensive language is typically used are required to train generalizable models. In this paper, we identify the shortcomings of existing Bangla HS datasets and introduce a large manually labeled dataset BD-SHS that includes HS in different social contexts. The labeling criteria were prepared following a hierarchical annotation process, which is the first of its kind in Bangla HS to the best of our knowledge. The dataset includes more than 50,200 offensive comments crawled from online social networking sites and is at least 60% larger than any existing Bangla HS datasets. We present the benchmark result of our dataset by training different NLP models resulting in the best one achieving an F1-score of 91.0%. In our experiments, we found that a word embedding trained exclusively using 1.47 million comments from social media and streaming sites consistently resulted in better modeling of HS detection in comparison to other pre-trained embeddings. Our dataset and all accompanying codes is publicly available at github.com/naurosromim/hate-speech-dataset-for-Bengali-social-media


title: A Flexible and Robust Vision Trap for Automated Part Feeder Design

abstract: Fast, robust, and flexible part feeding is essential for enabling automation of low volume, high variance assembly tasks. An actuated vision-based solution on a traditional vibratory feeder, referred to here as a vision trap, should in principle be able to meet these demands for a wide range of parts. However, in practice, the flexibility of such a trap is limited as an expert is needed to both identify manageable tasks and to configure the vision system. We propose a novel approach to vision trap design in which the identification of manageable tasks is automatic and the configuration of these tasks can be delegated to an automated feeder design system. We show that the trap's capabilities can be formalized in such a way that it integrates seamlessly into the ecosystem of automated feeder design. Our results on six canonical parts show great promise for autonomous configuration of feeder systems.


title: A note on forward iteration of inner functions

abstract: A well-known problem in holomorphic dynamics is to obtain Denjoy--Wolff-type results for compositions of self-maps of the unit disc. Here, we tackle the particular case of inner functions: if $f_n:\mathbb{D}\to\mathbb{D}$ are inner functions fixing the origin, we show that a limit function of $f_n\circ\cdots\circ f_1$ is either constant or an inner function. For the special case of Blaschke products, we prove a similar result and show, furthermore, that imposing certain conditions on the speed of convergence guarantees $L^1$ convergence of the boundary extensions. We give a counterexample showing that, without these extra conditions, the boundary extensions may diverge at all points of $\partial\mathbb{D}$.


title: Watch Your Back: Identifying Cybercrime Financial Relationships in Bitcoin through Back-and-Forth Exploration

abstract: Cybercriminals often leverage Bitcoin for their illicit activities. In this work, we propose back-and-forth exploration, a novel automated Bitcoin transaction tracing technique to identify cybercrime financial relationships. Given seed addresses belonging to a cybercrime campaign, it outputs a transaction graph, and identifies paths corresponding to relationships between the campaign under study and external services and other cybercrime campaigns. Back-and-forth exploration provides two key contributions. First, it explores both forward and backwards, instead of only forward as done by prior work, enabling the discovery of relationships that cannot be found by only exploring forward (e.g., deposits from clients of a mixer). Second, it prevents graph explosion by combining a tagging database with a machine learning classifier for identifying addresses belonging to exchanges. We evaluate back-and-forth exploration on 30 malware families. We build oracles for 4 families using Bitcoin for C&C and use them to demonstrate that back-and-forth exploration identifies 13 C&C signaling addresses missed by prior work, 8 of which are fundamentally missed by forward-only explorations. Our approach uncovers a wealth of services used by the malware including 44 exchanges, 11 gambling sites, 5 payment service providers, 4 underground markets, 4 mining pools, and 2 mixers. In 4 families, the relations include new attribution points missed by forward-only explorations. It also identifies relationships between the malware families and other cybercrime campaigns, highlighting how some malware operators participate in a variety of cybercriminal activities.


title: String Attractors and Infinite Words

abstract: The notion of string attractor has been introduced in [Kempa and Prezza, 2018] in the context of Data Compression and it represents a set of positions of a finite word in which all of its factors can be "attracted". The smallest size $\gamma^*$ of a string attractor for a finite word is a lower bound for several repetitiveness measures associated with the most common compression schemes, including BWT-based and LZ-based compressors. The combinatorial properties of the measure $\gamma^*$ have been studied in [Mantaci et al., 2021]. Very recently, a complexity measure, called string attractor profile function, has been introduced for infinite words, by evaluating $\gamma^*$ on each prefix. Such a measure has been studied for automatic sequences and linearly recurrent infinite words [Schaeffer and Shallit, 2021]. In this paper, we study the relationship between such a complexity measure and other well-known combinatorial notions related to repetitiveness in the context of infinite words, such as the factor complexity and the recurrence. Furthermore, we introduce new string attractor-based complexity measures, in which the structure and the distribution of positions in a string attractor of the prefixes of infinite words are considered. We show that such measures provide a finer classification of some infinite families of words.


title: NOMA for Integrating Sensing and Communications towards 6G: A Multiple Access Perspective

abstract: This article focuses on the development of integrated sensing and communications (ISAC) from a multiple access (MA) perspective, where the idea of non-orthogonal multiple access (NOMA) is exploited for harmoniously accommodating the sensing and communication functionalities. We first reveal that the developing trend of ISAC is from \emph{orthogonality} to \emph{non-orthogonality}, and introduce the fundamental models of the downlink and uplink ISAC while identifying the design challenges from the MA perspective. (1) For the downlink ISAC, we propose two novel designs, namely \emph{NOMA-empowered} downlink ISAC and \emph{NOMA-inspired} downlink ISAC to effectively coordinate the inter-user interference and the sensing-to-communication interference, respectively. (2) For the uplink ISAC, we first propose a \emph{pure-NOMA-based} uplink ISAC design, where a fixed communication-to-sensing successive interference cancellation order is employed for distinguishing the mixed sensing-communication signal received over the fully shared radio resources. Then, we propose a general \emph{semi-NOMA-based} uplink ISAC design, which includes the conventional orthogonal multiple access-based and pure-NOMA-based uplink ISAC as special cases, thus being capable of providing flexible resource allocation strategies between sensing and communication. Along each proposed NOMA-ISAC design, numerical results are provided for showing the superiority over conventional ISAC designs.


title: Smartphone-based crowdsourcing for estimating the bottleneck capacity in wireless networks

abstract: Crowdsourcing enables the fine-grained characterization and performance evaluation of today's large-scale networks using the power of the masses and distributed intelligence. This paper presents SmartProbe, a system that assesses the bottleneck capacity of Internet paths using smartphones, from a mobile crowdsourcing perspective. With SmartProbe measurement activities are more bandwidth efficient compared to similar systems, and a larger number of users can be supported. An application based on SmartProbe is also presented: georeferenced measurements are mapped and used to compare the performance of mobile broadband operators in wide areas. Results from one year of operation are included.


title: YOLoC: DeploY Large-Scale Neural Network by ROM-based Computing-in-Memory using ResiduaL Branch on a Chip

abstract: Computing-in-memory (CiM) is a promising technique to achieve high energy efficiency in data-intensive matrix-vector multiplication (MVM) by relieving the memory bottleneck. Unfortunately, due to the limited SRAM capacity, existing SRAM-based CiM needs to reload the weights from DRAM in large-scale networks. This undesired fact weakens the energy efficiency significantly. This work, for the first time, proposes the concept, design, and optimization of computing-in-ROM to achieve much higher on-chip memory capacity, and thus less DRAM access and lower energy consumption. Furthermore, to support different computing scenarios with varying weights, a weight fine-tune technique, namely Residual Branch (ReBranch), is also proposed. ReBranch combines ROM-CiM and assisting SRAM-CiM to ahieve high versatility. YOLoC, a ReBranch-assisted ROM-CiM framework for object detection is presented and evaluated. With the same area in 28nm CMOS, YOLoC for several datasets has shown significant energy efficiency improvement by 14.8x for YOLO (Darknet-19) and 4.8x for ResNet-18, with <8% latency overhead and almost no mean average precision (mAP) loss (-0.5% ~ +0.2%), compared with the fully SRAM-based CiM.


abstract: Deep clustering has attracted increasing attention in recent years due to its capability of joint representation learning and clustering via deep neural networks. In its latest developments, the contrastive learning has emerged as an effective technique to substantially enhance the deep clustering performance. However, the existing contrastive learning based deep clustering algorithms mostly focus on some carefully-designed augmentations (often with limited transformations to preserve the structure), referred to as weak augmentations, but cannot go beyond the weak augmentations to explore the more opportunities in stronger augmentations (with more aggressive transformations or even severe distortions). In this paper, we present an end-to-end deep clustering approach termed Strongly Augmented Contrastive Clustering (SACC), which extends the conventional two-augmentation-view paradigm to multiple views and jointly leverages strong and weak augmentations for strengthened deep clustering. Particularly, we utilize a backbone network with triply-shared weights, where a strongly augmented view and two weakly augmented views are incorporated. Based on the representations produced by the backbone, the weak-weak view pair and the strong-weak view pairs are simultaneously exploited for the instance-level contrastive learning (via an instance projector) and the cluster-level contrastive learning (via a cluster projector), which, together with the backbone, can be jointly optimized in a purely unsupervised manner. Experimental results on five challenging image datasets have shown the superiority of our SACC approach over the state-of-the-art. The code is available at https://github.com/dengxiaozhi/SACC.


title: The statistical nature of h-index of a network node

abstract: Evaluating the importance of a network node is a crucial task in network science and graph data mining. H-index is a popular centrality measure for this task, however, there is still a lack of its interpretation from a rigorous statistical aspect. Here we show the statistical nature of h-index from the perspective of order statistics, and we obtain a new family of centrality indices by generalizing the h-index along this direction. The theoretical and empirical evidences show that such a statistical interpretation enables us to obtain a general and versatile framework for quantifying the importance of a network node. Under this framework, many new centrality indices can be derived and some of which can be more accurate and robust than h-index. We believe that this research opens up new avenues for developing more effective indices for node importance quantification from a viewpoint that still remains unexplored.


title: Graph Signal Sampling Under Stochastic Priors

abstract: We propose a generalized sampling framework for stochastic graph signals. Stochastic graph signals are characterized by graph wide sense stationarity (GWSS) which is an extension of wide sense stationarity (WSS) for standard time-domain signals. In this paper, graph signals are assumed to satisfy the GWSS conditions and we study their sampling as well as recovery procedures. In generalized sampling, a correction filter is inserted between sampling and reconstruction operators to compensate for non-ideal measurements. We propose a design method for the correction filters to reduce the mean-squared error (MSE) between original and reconstructed graph signals. We derive the correction filters for two cases: The reconstruction filter is arbitrarily chosen or predefined. The proposed framework allows for arbitrary sampling methods, i.e., sampling in the vertex or graph frequency domain. We also show that the graph spectral response of the resulting correction filter parallels that for generalized sampling for WSS signals if sampling is performed in the graph frequency domain. Furthermore, we reveal the theoretical connection between the proposed and existing correction filters. The effectiveness of our approach is validated via experiments by comparing its MSE with existing approaches.


title: Neural Improvement Heuristics for Graph Combinatorial Optimization Problems

abstract: Recent advances in graph neural network architectures and increased computation power have revolutionized the field of combinatorial optimization (CO). Among the proposed models for CO problems, Neural Improvement (NI) models have been particularly successful. However, existing NI approaches are limited in their applicability to problems where crucial information is encoded in the edges, as they only consider node features and node-wise positional encodings. To overcome this limitation, we introduce a novel NI model capable of handling graph-based problems where information is encoded in the nodes, edges, or both. The presented model serves as a fundamental component for hill-climbing-based algorithms that guide the selection of neighborhood operations for each iteration. Conducted experiments demonstrate that the proposed model can recommend neighborhood operations that outperform conventional versions for the Preference Ranking Problem with a performance in the 99th percentile. We also extend the proposal to two well-known problems: the Traveling Salesman Problem and the Graph Partitioning Problem, recommending operations in the 98th and 97th percentile, respectively.


abstract: With the recent promising results of contrastive learning in the self-supervised learning paradigm, supervised contrastive learning has successfully extended these contrastive approaches to supervised contexts, outperforming cross-entropy on various datasets. However, supervised contrastive learning inherently employs label information in a binary form--either positive or negative--using a one-hot target vector. This structure struggles to adapt to methods that exploit label information as a probability distribution, such as CutMix and knowledge distillation. In this paper, we introduce a generalized supervised contrastive loss, which measures cross-entropy between label similarity and latent similarity. This concept enhances the capabilities of supervised contrastive loss by fully utilizing the label distribution and enabling the adaptation of various existing techniques for training modern neural networks. Leveraging this generalized supervised contrastive loss, we construct a tailored framework: the Generalized Supervised Contrastive Learning (GenSCL). Compared to existing contrastive learning frameworks, GenSCL incorporates additional enhancements, including advanced image-based regularization techniques and an arbitrary teacher classifier. When applied to ResNet50 with the Momentum Contrast technique, GenSCL achieves a top-1 accuracy of 77.3% on ImageNet, a 4.1% relative improvement over traditional supervised contrastive learning. Moreover, our method establishes new state-of-the-art accuracies of 98.2% and 87.0% on CIFAR10 and CIFAR100 respectively when applied to ResNet50, marking the highest reported figures for this architecture.


title: Mining Function Homology of Bot Loaders from Honeypot Logs

abstract: Self-contained loaders are widely adopted in botnets for injecting loading commands and spawning new bots. While researchers can dissect bot clients to get various information of botnets, the cloud-based and self-contained design of loaders effectively hinders researchers from understanding the loaders' evolution and variation using classic methods. The decoupled nature of bot loaders also dramatically reduces the feasibility of investigating relationships among clients and infrastructures. In this paper, we propose a text-based method to investigate and analyze details of bot loaders using honeypots. We leverage high interaction honeypots to collect request logs and define eight families of bot loaders based on the result of agglomerative clustering. At the function level, we push our study further to explore their homological relationship based on similarity analysis of request logs using sequence aligning techniques. This further exploration discloses that the released code of Mirai keeps spawning new generations of botnets both on the client and the server side. This paper uncovers the homology of active botnet infrastructures, providing a new prospect on finding covert relationships among cybercrimes. Bot loaders are precisely investigated at the function level to yield a new insight for researchers to identify the botnet's infrastructures and track their evolution over time.


title: DiVAE: Photorealistic Images Synthesis with Denoising Diffusion Decoder

abstract: Recently most successful image synthesis models are multi stage process to combine the advantages of different methods, which always includes a VAE-like model for faithfully reconstructing embedding to image and a prior model to generate image embedding. At the same time, diffusion models have shown be capacity to generate high-quality synthetic images. Our work proposes a VQ-VAE architecture model with a diffusion decoder (DiVAE) to work as the reconstructing component in image synthesis. We explore how to input image embedding into diffusion model for excellent performance and find that simple modification on diffusion's UNet can achieve it. Training on ImageNet, Our model achieves state-of-the-art results and generates more photorealistic images specifically. In addition, we apply the DiVAE with an Auto-regressive generator on conditional synthesis tasks to perform more human-feeling and detailed samples.


title: Hypercritical deformed Hermitian-Yang-Mills equation revisited

abstract: In this paper, we study the hypercritical deformed Hermitian-Yang-Mills equation on compact K\"ahler manifolds and resolve two conjectures of Collins-Yau.